دیجی‌پی

Data Engineer

دیجی‌پی

حداقل سابقه کار
مهم
موقعیت مکانی
تهران
نوع همکاری
پاره وقت
خدمت سربازی
مهم نیست

مهارت های موردنیاز

  • Python
  • SQL
  • Data engineer

Job Summary

We are looking for a skilled Data Engineer (Mid-Level+) to join our team at Digify. In this role, you will design, develop, and optimize scalable data infrastructure and pipelines, ensuring high performance, reliability, and data quality.
You will work with large-scale datasets, real-time streaming systems, and distributed data processing technologies while collaborating with cross-functional teams.


Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Python.
  • Build and optimize large-scale data processing workflows using Apache Spark and PySpark.
  • Develop and manage real-time streaming pipelines using Apache Kafka and Debezium.
  • Manage, optimize, and troubleshoot PostgreSQL and ClickHouse databases.
  • Orchestrate data workflows using Apache Airflow or Dagster.
  • Maintain and improve data infrastructure using Linux, Docker, and/or Kubernetes.
  • Monitor system performance and troubleshoot production issues using Grafana or Zabbix.
  • Ensure data quality, consistency, reliability, and pipeline fault tolerance.
  • Contribute to data architecture design and distributed system optimization.

Requirements

  • 3+ years of professional experience in Data Engineering or related fields.
  • Strong proficiency in Python, OOP, and clean coding practices.
  • Advanced SQL skills and hands-on experience with PostgreSQL and ClickHouse.
  • Practical experience with Apache Spark/PySpark and familiarity with Apache Flink.
  • Experience with Apache Kafka, Debezium, and CDC concepts.
  • Experience with workflow orchestration tools such as Apache Airflow or Dagster.
  • Strong Linux administration and troubleshooting skills (LPIC-1 level or equivalent).
  • Hands-on experience with Docker or Kubernetes.
  • Familiarity with monitoring tools such as Grafana or Zabbix.
  • Solid understanding of batch processing, stream processing, and distributed systems.
  • Strong problem-solving skills, ownership, and ability to work independently and collaboratively.

Nice to Have

  • Experience designing end-to-end data platforms.
  • Knowledge of Data Warehousing, Data Lakes, and Lakehouse architectures.
  • Experience optimizing ClickHouse and implementing CDC with Debezium.
  • Familiarity with CI/CD, Git, and Infrastructure as Code.
  • Understanding of exactly-once processing, idempotency, schema evolution, and data contracts.



درباره شرکت

دیجی‌پی یک استارتاپ جوان در حوزه پرداخت الکترونیک با مجوز پرداخت‌یاری است که حاصل ادغام استارتاپ هُماپی در هلدینگ دیجی‌کالا است.

دیجی‌پی در سال ۱۳۹۷ عضوی از خانواده دیجی‌کالا شد. هدف گروه دیجی‌کالا از ورود به حوزه فینتک، ارائه سرویس‌های پرداخت الکترونیک با پایداری بالا و بهترین تجربه برای مشتری بود. به دنبال تعریف این هدف، مسیر توسعه سرویس‌های دیجی‌پی مشخص شد.

محصولات شرکت:

-(Smart IPG) درگاه پرداخت هوشمند اینترنتی

-(Refund) بازگشت وجه به مشتری

-(Payout) پرداخت وجه با کیف پول تجاری

-اپلیکیشن موبایل دیجی‌پی

-(Smart Dashboard) داشبورد هوشمند

-کیف پول خرید اقساطی