Software Engineer, Core Technology Group (Data Engine)

Job Number: 32062

Position Title: Software Engineer

External Description:

Software Engineer, Core Technology Group (Data Engine) 

Our Company

Everything Informatica does begins and ends with data. Simply stated, we make great data – data that is connected, clean and safe -- ready to use so that all enterprises can be data ready and put their unique information potential to work. A data-ready enterprise is decision-ready, customer-ready, application-ready, cloud-ready, and regulation-ready. And by design, our Intelligent Data Platform delivers great data to enable our customers to be ready for anything. 

Our Team

Cloud Data Integration is the innovation hub within Informatica that is responsible for delivering an extensible, reliable and scalable platform that provides the solid foundation for all other Informatica products. Our team specifically has the following responsibilities:

• Converting user-created Big Data tasks into Spark Jobs
• Optimizing these Spark jobs for best performance
• Adding and modifying to the open-source spark code to serve Informatica use cases.
• Reducing latency and processing time of Spark jobs to return instantaneous results
• Delivering large data sets to client applications with extremely high throughput
• Cross compiler to translate representation of a data flow plan from one engine to Spark
• Deliver a highly scalable, performance-optimized infrastructure (both compute and storage) that elastically handles customer needs.
• Executing and monitoring Spark jobs and clusters for high performance and low TCO. 

Your Opportunity

Informatica Data Platform has been a key constituent of Informatica’s platform and serves multiple products such as Data Services, Data Quality, and Profiling. Informatica products rely on the Data Engine to fulfill the vision of a Virtual Data Machine which is capable of executing data integration jobs either natively or across execution environments such as Spark on Kubernetes, Spark on Yarn, Cloud DW. You will be a key contributor to Informatica’s next-generation platform and how it handles the volume, velocity, and variety of structured and unstructured data. It could be enterprise and partner data from hosted Cloud services and on-premise deployments or arbitrary data from social websites and media. 

Our Ideal Candidate

You are a software engineer who has a background or interest in DevOps engineering. You enjoy identifying productivity challenges in a development organization and resolving them. This role would be 50% DevOps and 50% backed engineering. 

Your Responsibilities

The successful candidate will be based in Redwood City, CA, and will be responsible for:

• Developing and maintaining our docker development environment.
• Resolving security vulnerabilities and CVEs identified by our security team to maintain product integrity.
• Work with other team members and to identify areas of improvement in our build systems and resolve productivity challenges.
• Working with senior members of the team to ensure the sound design and implementation of functional areas for the product
• Working closely with architects and developers and QA engineers to discuss and evangelize features
• Collaborating with geographically dispersed, cross-functional teams in an Agile environment
• Participating in internal/cross-team meetings, scoping, decision making, and technical documentation 

Your Qualifications

• BS in Computer Science or a related technical discipline; advanced degree preferred
• Demonstrated ability to write quality code in Java, Scala.
• Familiarity with big data technologies like Spark, Hive is a plus.
• Familiarity with cloud software concepts with experience in working with Docker and Kubernetes is a plus.
• Knowledge of AWS, Azure, GCP is a plus.
• Ability to communicate and express thoughts and ideas in a big group
• Strong analytical problem solving and decision-making skills 

City: Redwood City

State: California

Seniority Level: Associate

Alternative Location(s) :

Community / Marketing Title: Software Engineer, Core Technology Group (Data Engine)

Remote LinkedIn Hashtag:

LinkedIN Hashtag: LI-AS2

Company Profile:

EEO Employer Verbiage:

At Informatica we know diversity drives innovation. We are proud to be an Equal Opportunity Employer dedicated to maintaining a work environment free from discrimination, one where all employees are treated with dignity and respect. All qualified applicants will receive consideration for employment without regard to race, color, gender, sex, sexual orientation, marital status, religion, age, disability, gender identity, veteran status or any other characteristic protected by applicable law and Informatica policy.

Travel Requirement: Limited

Location_formattedLocationLong: Redwood City, California US