Data Engineer
- Collaborate with data architects and project managers to develop comprehensive data migration strategies for structured (e.g., relational databases) and unstructured data (e.g., documents, media).
- Use Qlik Replicate for real-time replication, Change Data Capture (CDC), and data migration from source databases to target environments.
- Ensure data integration across diverse sources (on-premises, cloud, ADLS, databases) into platforms like Azure, AWS, and Microsoft Dataverse.
- Automate tasks such as data validation, transformation, and reconciliation to ensure efficiency and consistency.
- Perform data profiling, cleansing, and transformation to support accurate mapping and merging of data formats.
- Conduct thorough testing (unit, integration, performance) and ensure the accuracy and completeness of migrated data.
- Troubleshoot data migration issues, optimize performance, and provide post-migration support.
- Create and maintain documentation for ETL workflows, data migration scripts, and configuration settings.
- Collaborate closely with stakeholders to provide status updates and resolve data-related challenges.
- Stay current with the latest data engineering tools, technologies, and best practices.
- Refactor current application’s Microsoft Dataverse database schema to comply with business logic rules and enhance database performance.
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proficient and experience with Microsoft Dynamics and integrating data into Microsoft Dataverse, interacting with tables, logic and validation, security, and developer capabilities.
- Experience with Azure services such as Azure Data Lake Storage (ADLS), Azure SQL Database, Synapse Analytics, and Event Hub for end-to-end data flow.
- Strong knowledge of data governance, security and compliance within Azure (RBAC, managed identities, and data encryption).
- Hands on experience with designing, developing, and maintaining data pipelines using Azure Data Factory, synapse pipelines, or similar orchestration.
- Experience with cloud-based data lake platforms such as Amazon S3, Databricks, and Snowflake
- 5+ years of experience in data engineering, specifically with data migration and integration projects.
- Proficiency in working with both structured (relational databases, data warehouses) and unstructured data (files, NoSQL, media).
- Experience with cloud platforms such as Azure and AWS for data migration and storage.
- Strong understanding of data modeling, data architecture, and data governance principles.
- Familiarity with SQL and NoSQL databases, as well as experience with large-scale data integration projects.
- Strong analytical, problem-solving, and debugging skills.
- Excellent verbal and written communication skills for collaboration across teams.
- Ability to work independently and manage multiple priorities in a fast-paced environment.
Recommended Jobs
Insider Threat Information Systems Security - Senior Data Analyst
Job Description Job Description H4 Enterprises are currently seeking the following: POSITION SUMMARY Insider Threat Information Systems Security - Senior Data Analyst will be responsible fo…
Junior Assistant Manager - Norfolk, VA
Rainbow USA is recognized as one of the fastest growing junior, kids, plus, and petite, specialty apparel retail chains and has grown to over 1,000 retail stores! We have multiple retail lines that p…
People Strategy Lead
The Building People LLC seeking a dynamic People Strategy Lead to join our team and help shape the employee experience in our fast-growing organization. This role is designed for an HR professional…
Mainframe Developer/Engineer
Req ID: 318423 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organiza…
Mid-Level java developer
JOB TITLE – Mid-Level Java developer Location: Arlington, VA; Bethesda, MD Travel: Start Date: Immediately Clearance Requirement: Public Trust TAX TERM :- C2C, W2 Pr oject D…
Data Scientist
Data Scientist Rapid Cycle Solutions LLC (RCS) is an innovative small business providing IT and management consulting services to the U.S. Federal Government and commercial clients. We have unique…
Experienced Teacher (Toddler-2) PM
Summary Someone who loves working with children, has at least one year experience and wants a company to grow with. Duties Duties will vary depending on the position. Requirements Ch…
Condenser Mechanic
Job Description Job Description We are looking for experienced, skilled mechanics to work in an industrial environment that includes the retubing of steam surface condensers and heat exchangers. …