The Staff Product Support Engineer will design, optimize, and manage Hadoop and Spark applications, solve data challenges, and ensure operational stability in a 24/7 environment.
ABOUT US
ABOUT THE ROLE
Acceldata is the market leader in Enterprise Data Observability. Founded in 2018 and backed by top investors including Insight Partners, March Capital, Lightspeed, Sorenson Ventures, Industry Ventures, and Emergent Ventures, we are a Series-C funded company headquartered in Silicon Valley.
Our Enterprise Data Observability Platform—the first of its kind—helps enterprises build and operate world-class data products by ensuring data is reliable, trusted, and ready to power today’s most critical technologies, including AI, LLMs, Analytics, and DataOps.
Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey’s, Dun & Bradstreet, and many more.
Staff Product Support Engineers at Acceldata are Hadoop Operations SMEs responsible for designing, optimizing, migrating, and scaling Hadoop- and Spark-based data processing systems. This role involves hands-on experience with Hadoop and other core data operations, focusing on building resilient, high-performance distributed data systems.
You will collaborate with Customer Engineering teams to deliver high-throughput Hadoop, NiFi, and Spark applications and solve complex data challenges in migration, upgrades, reliability, and optimize post-migration system performance.
This role requires flexibility to work in rotational shifts, based on team coverage needs and customer demand. Candidates should be comfortable supporting operations in a 24/7 environment and be willing to adjust their working hours accordingly.
RESPONSIBILITIES
- Design and optimize distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads.
- Troubleshooting: Provide expert-level support for data or performance issues in Hadoop, NiFi, and Spark jobs and clusters.
- Data Processing Expertise: Work extensively with large-scale data pipelines using Hadoop, NiFi, and Spark's core components.
- Performance Tuning: Conduct deep-dive performance analysis, debugging, and optimization of NiFi, Impala, and Spark jobs to reduce processing time and resource consumption.
- Cluster Management: Collaborate with DevOps and infrastructure teams to manage NiFi, Impala, and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.).
- Migration: Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimize system performance following the ODP migration.
REQUIREMENTS
- Strong hands-on experience with distributed data processing frameworks, including Hadoop, Spark, and NiFi, with a deep understanding of their core components and architecture.
- Proven ability to analyze, troubleshoot, and optimize large-scale data pipelines and jobs (Spark, NiFi, Impala) to improve performance, reduce latency, and increase throughput.
- Demonstrated experience diagnosing and resolving complex data and performance issues across Hadoop ecosystems, including cluster-level and application-level debugging.
- Extensive experience building and maintaining scalable data pipelines that process large volumes of data efficiently in distributed environments.
- Familiarity with managing and operating clusters using technologies such as Hadoop/YARN, Kubernetes, and cloud-based platforms like AWS EMR or GCP Dataproc.
- Experience working cross-functionally with DevOps and infrastructure teams to support deployment, scaling, and reliability of distributed systems.
- Experience supporting platform migrations (e.g., Hadoop distributions or ODP environments), ensuring system stability, performance optimization, and issue resolution during and post-migration.
- Strong analytical mindset with the ability to perform deep-dive investigations into system performance and implement effective, scalable solutions. PREFERRED REQUIREMENTS
- Experience working with scripting languages (Scala, Python, Bash, PowerShell).
- Bachelor's degree required, Master’s degree preferred.
- Familiarity with virtual machine technologies and multi-node environment (50+ nodes).
- Proficient with Linux, NFS, and Windows, including application installation, scripting, and working with the command line.
- Working knowledge of application, server, and network security management concepts. Certification on any of the leading Cloud providers (AWS, Azure, GCP ) and/or Kubernetes.
- Knowledge of databases like MySQL and PostgreSQL.
- Be involved with and work on other support-related activities - Performing POC & assisting with Onboarding deployments of Acceldata & Hadoop distribution products.
At Acceldata, we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities.
#LifeAtAcceldata is all about working with some of the best minds in the industry and experiencing a culture that values an ‘out-of-the-box’ mindset. If you want to push boundaries, learn continuously, and grow to be the best version of yourself, Acceldata is the place to be!
We also believe in providing our employees with the right tools and resources to help them excel at their job. We offer:
- Flexible PTO Plan
- Up to 100% employer-paid benefits for health, dental, and vision coverage for specific plans
- Discounts and offerings for major vendors through our PEO
- Apple Air Mac Equipment
- Becoming part of the team that coined the term “Data Observability”!
Similar Jobs
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
The Senior Executive Assistant will support senior leadership by managing calendars, coordinating meetings, handling travel arrangements, and facilitating internal communications and events.
Top Skills:
ConfluenceGoogle SuiteSlackZoom
eCommerce • Fashion • Other • Retail • Sales • Wearables • Design
The Sales Associate II will enhance customer experience by building relationships, driving sales, managing store operations, and delivering exceptional service while achieving sales goals.
Top Skills:
Clienteling ToolsMobile PosPos SystemsSocial Selling Platforms
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Design and develop backend services and APIs for identity resolution, optimize event-driven systems, and enhance system reliability. Mentor engineers and influence architectural decisions.
Top Skills:
AerospikeAWSCouchbaseEksFlinkHbaseHelmHiveJavaKafkaKubernetesPythonScalaScyllaSnowflakeSparkSQL
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
