Job Overview
Role: Application Development (Junior Data Engineering Support) Location: Pune Experience: Freshers/Experienced Qualification: B.E/B.Tech Key Skills: Data engineering support, SQL, ETL/ELT processes, pipeline monitoring, incident management, production support, operational reporting, data validation, ServiceNow, Python, cloud data technologies
Job Description
The Application Development position is focused on supporting data engineering pipelines and applications. Although the job title is broad, the supplied description clearly positions the role around junior data engineering support and production operations. The selected candidate will work under the supervision of intermediate and senior engineers and will be responsible for monitoring pipelines, performing first-level troubleshooting, validating data, updating service tickets, and maintaining operational documentation.
Roles and Responsibilities
- Pipeline Monitoring: Monitoring scheduled data pipeline runs (job status, alerts, file arrivals, data refresh activities).
- Troubleshooting: Performing initial checks and first-level troubleshooting (checking job status, examining logs, validating input files, running basic SQL queries, checking data output, collecting error information).
- Data Validation: Using SQL to validate whether data has been processed correctly (including source-to-target reconciliation).
- Incident Management: Creating, updating, and tracking incidents, service requests, tasks, and change requests in ServiceNow.
- Production Support: Performing routine production support activities (monitoring scheduled jobs, responding to alerts, checking failed processes, validating data, preparing status reports, escalating complex technical problems).
- Documentation: Supporting documentation, runbooks, SOPs, operational checklists, daily status updates, and knowledge transfer activities.
- Reporting: Supporting monitoring reports and basic operational reporting.
Skills and Eligibility Criteria
Educational Background: B.E/B.Tech.
Experience: Freshers and experienced candidates can apply.
Mandatory Technical Skills:
- Basic SQL.
- Basic ETL/ELT concepts.
- Data validation.
- Data pipeline monitoring.
- Incident management.
- Production support.
- ServiceNow ticket updates.
- Technical documentation.
- First-level troubleshooting.
- Basic operational reporting.
Competencies:
- Willingness to learn data engineering support processes.
- File-based data ingestion (Good-to-Have).
- Basic understanding of SFTP (Good-to-Have).
- AWS S3 basics (Good-to-Have).
- AWS Glue awareness (Good-to-Have).
- Snowflake awareness (Good-to-Have).
- Databricks awareness (Good-to-Have).
- Basic Python (Good-to-Have).
- CloudWatch or equivalent monitoring tools (Good-to-Have).
- Runbook support (Good-to-Have).