“IBM” Openings for Big Data AWS Engineer

Fresher Jobs Bangalore IBM

Job Role: Big Data AWS Engineer

Eligibility: Graduate

Experience: Freshers/ Experienced

Job Location: Bangalore

Company Profile:

IBM Software infuses core business operations with intelligence—from machine learning to generative AI—to help make organizations more responsive, productive, and resilient. IBM Software helps clients put AI into action now to create real value with trust, speed, and confidence across digital labor, IT automation, application modernization, security, and sustainability. Critical to this is the ability to make use of all data, because AI is only as good as the data that fuels it. In most organizations data is spread across multiple clouds, on premises, in private datacenters, and at the edge.

Responsibilities:

  • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
  • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
  • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

Required Skills:

  • Developed the Pysprk code for AWS Glue jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..
  • Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Hadoop streaming Jobs using python for integrating Python API supported applications..
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD’s were used to apply business transformations and utilized Hive Context objects to perform read/write operations..
  • Re – write some Hive queries to Spark SQL to reduce the overall batch time

Join us on Telegram For More Updates: https://t.me/nareshit

To apply for this job please visit careers.ibm.com.

Demo's_kphb_branch