Data Engineer
| Published Date : Jan 30, 2024 Category : Jobs » Engineering Jobs Location : Karnataka » Bangalore
Description : Requirements: Min. 5 years of experience with python and Java data engineering Experience in Developing Data Pipelines using Python, PySpark, Pandas etc, on AWS/Azure Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.) Experience in developing ETL, OLAP based and Analytical Applications. Experience in ingesting batch and streaming data from various data sources. Experience in AWS EMR, S3, IAM & AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.) Proficiency in Azure technologies such as ADF, ADB & ADLS, Azure key vault, Azure SQL-DB, Azure HD Insight Experience working on Test cases using pytest/unittest or any other framework. Snowflake or Redshift data warehouses Familiarity with Rest APIs and use of... |