Data Engineer

Core Database skillsets using SQL Server and Postgres

• Database Design and Implementation:
  • Conceptual, Logical, and Physical Design: Developing and implementing database schemas, including tables, indexes, views, stored procedures, and triggers to meet business requirements and ensure data integrity.
  • Data Modeling: Creating data models that represent the structure of the data, relationships between entities, and how data will be stored and accessed.
  • Table partitions and archiving.
  • Database Migration: Planning and executing database migrations ensuring data integrity and minimal downtime.
• Database Administration and Maintenance:
  • Performance Tuning: Identifying and resolving performance bottlenecks, optimizing queries, indexes, and database configurations to improve query execution speed and overall system efficiency.
  • Monitoring and Troubleshooting: Continuously monitoring database performance, identifying and resolving issues, troubleshooting errors, and ensuring system stability and availability.
  • (Optional) Backup and Recovery: Implementing and managing backup and recovery strategies, including regular backups, disaster recovery plans, and data restoration procedures to ensure data availability and prevent data loss.
  • (Optional) Security Management: Implementing and enforcing security measures, including user authentication, authorization, access controls, and data encryption to protect sensitive data from unauthorized access and breaches.
  • (Optional) Data Integrity and Quality: Implementing procedures and checks to ensure data accuracy, consistency, and validity, including validation rules, data cleansing, and data quality monitoring.
• Database Development and Support:
  • SQL Development: Writing efficient and optimized SQL queries, stored procedures, functions, and triggers to perform data manipulation, retrieval, and analysis.
  • (Optional) Database Scripting: Creating and maintaining scripts for database administration tasks, including database creation, schema changes, data loading, and automated backups.
• Advanced Database Technologies:
  • High Availability and Disaster Recovery: Implementing and managing high availability solutions, including database mirroring, log shipping, and Always On Availability Groups, to ensure continuous database availability.
  • (Optional) Data Warehousing and Business Intelligence: Designing and implementing data warehouses, data marts, and business intelligence solutions to support data analysis and reporting.
  • (Optional) Cloud Database Solutions: Understanding and implementing cloud-based database solutions, including AWS RDS, to leverage cloud infrastructure and scalability.
  • (Optional) Data Replication and Distribution: Implementing data replication and distribution strategies to ensure data consistency across multiple databases or locations.