IS&T Consulting Group
Required Skills
| Skill | Years of Experience | Expertise Level | Skill Requirement Level |
|---|---|---|---|
| AZURE DATABRICKS | 4-5 | 4 | Required |
| Unity-Catalog | 4-5 | 4 | Required |
| Data-Engineer | 4-5 | 4 | Required |
| AZURE DATA LAKE | 4-5 | 4 | Required |
Job Description
Sr Data Engineer
Can lead projects
Mentor junior Data Engineers
Power BI
Data engineers design, build, and maintain the infrastructure for data generation, storage, and processing. They handle raw, unstructured data, ensuring it is clean, reliable, and accessible. This involves creating ETL pipelines, managing databases (SQL, NoSQL), and working with tools like Apache Spark, Kafka, Airflow, Snowflake, and Databricks. They often use Python, Java, Scala, and SQL to implement scalable data architectures.
Azure Data Bricks with Unity catalogue
Azure Synapse
PySpark
Data Ingestion
Data pipelines
Data Engineer
Do not want DBA or Data Scientist masquerading as a Data Engineer