IS&T Consulting Group
Required Skills
| Skill | Years of Experience | Expertise Level | Skill Requirement Level |
|---|---|---|---|
| AZURE DATABRICKS | 4-5 | 4 | Required |
| Unity-Catalog | 4-5 | 4 | Required |
| Data-Engineer | 4-5 | 4 | Required |
| AZURE DATA LAKE | 4-5 | 4 | Required |
Job Description
Sr Data Engineer Can lead projects Mentor junior Data Engineers Power BI Data engineers design, build, and maintain the infrastructure for data generation, storage, and processing. They handle raw, unstructured data, ensuring it is clean, reliable, and accessible. This involves creating ETL pipelines, managing databases (SQL, NoSQL), and working with tools like Apache Spark, Kafka, Airflow, Snowflake, and Databricks. They often use Python, Java, Scala, and SQL to implement scalable data architectures. Azure Data Bricks with Unity catalogue Azure Synapse PySpark Data Ingestion Data pipelines Data Engineer Do not want DBA or Data Scientist masquerading as a Data Engineer