Big Data Engineer
Location: Bengaluru, Karnataka, India
Job Number: 35255
Position Title: IT Automation Engineer
External Description:
Build Your Career at Informatica
We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous, work-from-anywhere minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas forward, united by a passion to create a world where data improves the quality of life for people and businesses everywhere.
Big Data Engineer
We're looking for a Big Data Engineer with experience in Hadoop, cloudera, HDI, Python, and to join our team in Bangalore.
You will report to the Senior Manager, Information Technology.
Technology You'll Use
Bigdata, python, Hadoop, and Cloudera
Your Role Responsibilities? Here's What You'll Do
- Meet with Business teams to understand their requirements
- Develop Hadoop systems
- Experience with distributed computing principles
- Deployment and management of Hadoop-cluster across multiple distributions - Cloudera/MapR/Hortonworks/EMR/HDI/DataProc/Databricks, with all included services
- Finalize the scope of the system and delivering Big Data solutions
- solve the operational issues on live clusters
- Build stream-processing and messaging systems, using solutions such as Kafka or Spark-Streaming
- Load disparate data sets and conduct pre-processing services using Hive, Impala
- Integrate data from multiple data sources
- Collaborate with the software research and development teams
- Build cloud platforms to develop business applications
- Manage the communications between the internal customer teams and the vendor
- Manage production systems
What We'd Like to See
- Proficiency with Hadoop v2, MapReduce, HDFS
- Working knowledge of NoSQL databases, such as HBase and MongoDB
- Knowledge of multiple ETL techniques and frameworks – Experience on Informatica ETL products
- Define data retention policies, backup implementation and retrieval
Role Essentials
- In-depth knowledge of Hadoop, Spark, Tez and similar frameworks
- Knowledge of scripting languages including Python, shell and R
- Knowledge of NoSQL and RDBMS databases including Redis and MongoDB
- Knowledge on cloud based storage – Azure, AWS and GCS storage services
- Knowledge of microservices and containerisation - Kubernetes, Docker and chef tools
- Excellent project management skills
- solve complex networking, data, and software issues
- Bachelor's degree in computer engineering or equivalent, we will consider an equivalent combination of relevant education and experience
- Minimum 2+ years of relevant professional experience
Perks & Benefits
- Comprehensive health, vision, and wellness benefits (Paid parental leave, adoption benefits, life insurance, disability insurance and 401k plan or international pension/retirement plans
- Flexible time-off policy and hybrid working practices
- Tuition reimbursement program to support your and personal growth
- Equity opportunities and an employee stock purchase program (ESPP)
- Comprehensive Mental Health and Employee Assistance Program (EAP) benefit
We're guided by our DATA values and we are passionate about building and delivering solutions that accelerate data innovations. At Informatica, we know diversity drives innovation. We are proud to be an Equal Opportunity Employer dedicated to maintaining a work environment free from discrimination, one where all employees are treated with dignity.
Informatica (NYSE: INFA), an Enterprise Cloud Data Management leader, brings data to life by empowering businesses to realize the transformative power of their most critical assets. We have pioneered the Informatica Intelligent Data Management Cloud™ (IDMC) that manages data across any multi-cloud, hybrid system, democratizing data to advance business strategies. Customers in over 100 countries and 85 of the Fortune 100 rely on Informatica. www.informatica.com. Connect with LinkedIn, Twitter, and Facebook. Informatica. Where data comes to life.
City: Bangalore
State: Karnataka
Seniority Level: Associate
Alternative Location(s) :
Community / Marketing Title: Big Data Engineer
Remote LinkedIn Hashtag:
LinkedIN Hashtag: LI-SK1
Company Profile:
EEO Employer Verbiage:
At Informatica we know diversity drives innovation. We are proud to be an Equal Opportunity Employer dedicated to maintaining a work environment free from discrimination, one where all employees are treated with dignity and respect. All qualified applicants will receive consideration for employment without regard to race, color, gender, sex, sexual orientation, marital status, religion, age, disability, gender identity, veteran status or any other characteristic protected by applicable law and Informatica policy.
Travel Requirement: Limited
Location_formattedLocationLong: Bangalore, Karnataka IN