Senior Software Development Engineer – Biga Data and Spark

The Opportunity

Adobe Experience Platform is the Adobe solution that helps customers to centralize and standardize their customer data and content across the enterprise powering 360-degree customer profiles, enabling data science and data governance to drive real-time personalized experiences. With Experience Platform, enterprises will be able to use completely coordinated marketing and analytics solutions for driving relevant customer interactions.

Our engineering team is responsible for building the Adobe Experience Platform. We help thousands of customers collect, handle and synthesize petabytes of data with high fidelity and velocity. We help them make sense of that data, glean insights and run algorithms, so they can deliver delightful experiences in real-time, every time.

This position is for a key contributor who will be a part in developing modern data architectures, developing Big Data and Lakehouse solutions, and implementing those solutions through to production.

This role blends data infrastructure, AI workflows, and multi-cloud technologies to drive real-time customer intelligence. If you enjoy solving complex challenges and working in a collaborative, fast-paced environment, we want to hear from you!

What you’ll do

• Be engaged in all the product development and delivery stages, as part of an agile engineering team.
• Play an important role in shaping the technical direction of our service(s).
• Deliver automation to prevent problem recurrence and automate responses to all non-exceptional service conditions.
• Scale our product services using traditional software engineering guidelines.
• Contribute to and promote good software engineering practices across the team, maintaining high standards.
• Collaborate with various internal teams and external partners to provide a high-quality customer experience.
• Work in an environment that supports individual growth and continuous learning.
• Perform on-call activities, on follow the Sun rotation with the rest of the team
• Possibility to contribute to Open Source projects.
• Continually evaluate and adopt the latest industry technologies to optimize costs and increase efficiency.
• Participate fully in a culture that supports innovation and creativity while delivering high output in a predictable and reliable way.

Requirements

• 4 or more years of software development and technical operations experience, with a focus on delivering high-scale data processing solutions in a production environment
• Proven expertise in big data processing field with Apache Spark and other compute platforms and frameworks.
• Good understanding of table formats, schema evolution, and advanced data modeling.
• Hands-on experience with performance optimization, large-scale cluster tuning, and efficient big data architectures.
• Solid programming skills in Scala/Java or Python, with the ability to engineer robust, maintainable pipelines.
• Validated ability to research and become proficient in new emergent technologies, with a emphasis on leveraging AI coding agents to enhance productivity and streamline collaboration throughout the entire software lifecycle process.
• Validated experience implementing observability best practices—monitoring, logging, and tracing—across distributed data systems.
• A problem-solving approach, capable of diagnosing root causes and delivering solutions for complex data challenges.
• Commitment to the highest levels of quality, puts focus both in testing and code development
• MUST possess a BS/MS in Computer Science or equivalent experience.
• Excellent communication skills (verbal and written) are critical to the role.
• Very good English language knowledge, written and spoken
• Able to work efficiently across various time zones to coordinate with colleagues in different regions.

Bonus skills

• Experience with Big Data technologies, i.e. Hadoop/HBase/MapReduce/Iceberg/DeltaLake/Kafka, Databricks it’s a plus
• Experience in working with infrastructure, i.e. cloud providers, containers, Kubernetes, VM/Bare metal deployments, is a plus

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.

Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours.

Let’s Adobe together

At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.

Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.

Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email [email protected] or call +1 408-536-3015.

AI Use Guidelines for Interviews:

Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.

At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.

Read Full Description