Workinvirtual
We are seeking a highly motivated and experienced Data Engineer to join our growing team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure. You will work closely with data scientists, analysts, and other engineers to ensure data quality, availability, and performance. This role requires a strong understanding of data engineering principles, experience with various data technologies, and a passion for solving complex data challenges.
Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines using various ETL (Extract, Transform, Load) tools and techniques.
- Build and optimize data warehouses and data lakes to support business intelligence and analytics.
- Ensure data quality, integrity, and consistency across all data systems.
- Monitor and troubleshoot data pipelines and infrastructure to ensure optimal performance and availability.
- Collaborate with data scientists and analysts to understand their data needs and provide them with the necessary data resources.
- Implement data governance and security policies to protect sensitive data.
- Research and evaluate new data technologies and tools to improve our data infrastructure.
- Automate data-related tasks and processes to increase efficiency.
- Contribute to the development of data documentation and best practices.
- Stay up-to-date with the latest trends and technologies in data engineering.
Required Skills and Experience:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering or a related role.
- Strong understanding of data engineering principles and best practices.
- Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server).
- Experience with cloud-based data warehousing solutions (e.g., Snowflake, BigQuery, Redshift).
- Experience with ETL tools and technologies (e.g., Apache Airflow, Informatica, Matillion).
- Experience with big data processing frameworks (e.g., Spark, Hadoop).
- Experience with data visualization tools (e.g., Tableau, Power BI) is a plus.
- Strong programming skills in Python or another scripting language.
- Excellent problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Excellent communication and collaboration skills.
Apply Now: https://workinvirtual.com/application-tracking-system/