Azure Data Engineer Job at VTal Technology Solutions, United States

  • VTal Technology Solutions
  • United States

Job Description

Azure Data Engineer

Azure Data Engineer will be responsible for implementing data ingestion and transformation pipelines. We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and delivering end-to-end production implementation. Performance Team and Damco Distribution, now part of the Maersk global organization under a combined Warehousing & Distribution division, offer third party logistics services to over 500 customers. Encompassing almost 15 million square feet of warehousing capacity throughout the country and a large transportation segment capturing a variety of services, we have key supply chain hubs in the Los Angeles and New Jersey/New York areas, and other facilities along the Western & Eastern coasts along with multiple locations in the Midwest. Delivering significant sales and profitability growth, we will drive the Inland Logistics and Services business for the combined US business units for Maersk.

Key Responsibilities

Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure tools Developing scalable and re-usable frameworks for ingesting of assorted data sets Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained Manage and lead junior data engineers and provide guidance, support and mentor other members of the team as well as do hands-on work Working with event based / streaming technologies to ingest and process data Working with other team members for implementing data pipelines and solutions in production using DevOps for deployment/automation Working with Azure CI/CD pipelines Delivering and presenting technical solutions to business users, technical teams and clients

Qualifications:
  • Strong knowledge of Data Management principles
  • Experience in building ETL / data warehouse transformation processes
  • Direct experience of building data pipelines using one of the following Azure Data Factory, Azure Synapse, Azure Databricks
  • Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Azure AI), Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
  • Ability to work seamlessly within a team, react quickly to a fast paced, and rapidly changing environment
  • Strong capacity for logical thinking with the ability to understand complex applications
  • 5+ years hands on experience using databases
  • Excellent written and verbal communication skills

Education and Preferred Experience:

  • Bachelor's degree or combination of equivalent education and experience in related fields.
  • 10+ years hands on experience providing solution design with BI systems and BI reports.
  • Experience using geospatial frameworks on Apache Spark and associated design and development patterns
  • Expert or professional level Azure certifications is a plus

Job Tags

Remote work

Similar Jobs

The Salvation Army ARC Pasadena

Assistant Manager - Glendale Store Job at The Salvation Army ARC Pasadena

 ...dependent on the diligence and devotion of its employees. ABOUT OUR RETAIL TEAM Become part of the dedicated Retail Team at The...  ...through the commitment to Do The Most Good at our Glendale Thrift Store, which supports the Adult Rehabilitation Program. This is an... 

work from home job

Remote Data Entry Specialist - Work From Home Job at work from home job

 ...A remote data entry position is available, where the Data Entry Clerk will be responsible for accurately inputting data into the company...  ..., and show attention to detail. This position allows for work from home, offering flexibility and the chance to assist customers remotely... 

Boardwalk IG Management LLC

Night Auditor Job at Boardwalk IG Management LLC

 ...for computer procedures daily Balance the day's work (i.e movie revenue, telephone, postings, valet, laundry, server's, and desk agent's paperwork etc.) Maintain cashiering responsibilities as per Front Office procedures Maintain Front Office computer system operation... 

Boston Children's Hospital

Sterile Processing Technician Job at Boston Children's Hospital

Boston Childrens Hospital is seeking a QA Tech, Sterile Processing professional to support our pediatric surgical teams by ensuring safe, sterile instruments and supplies. In this role, you will decontaminate, inspect, assemble, package, and sterilize surgical instruments... 

CarolinaEast Health System

Nurse Midwife Job at CarolinaEast Health System

 ...Certified Nurse Midwife The Certified Nurse Midwife (CNM) provides comprehensive, compassionate care to women throughout their reproductive lifecycle, including prenatal, labor, delivery, and postpartum care. In addition to maternity care, the CNM may offer gynecological...