Senior Big Data Engineer

The CHI Software is looking for Senior Big Data Engineer.

Requirements:

● Active GitHub/GitLab/Bitbucket account;
● 5+ years professional experience;
● Python 3.6+, Django;
● React;
● Bash/Shell Scripting;
● Snowflake;
● Postgres;
● Strong SQL skills;
● Pytest, unittest;
● REST API’s, Microservices, Swagger/OpenAPI, FastAPI;
● SQL and No SQL datastores, Postgres, MongoDB, Reddis;
● Spark/PySpark/Pandas;
● Docker/Kubernetes.

Nice to Haves:

● D3.js, Plotly, Highcharts, Shiny, or other Data Visualization tools;
● GoLang;
● CircleCI, CI/CD;
● GraphQL;
● Ansible/Chef/Puppet
● Terraform;
● DevOps, DevSecOps, Application Security.

Responsibilities:

● Design, develop, maintain, and deploy complex data and ETL pipeline solutions using; Apache Airflow, Kubernetes, Python (RESTful server side API’s) stacks and cloud services (GCP);
● Work with cloud systems, pipelines and resources;
● Perform data storage and persistence containers querying using SQL, NoSQL and caching technologies;
● Develop loosely coupled solutions that are scalable, testable, modularized and reusable;
● Develop solutions that leverage existing frameworks and libraries, align with the overall company architecture and vision;
● Build scalable and tolerant systems using container technologies (Docker) and cloud infrastructure (Kubernetes, GCP) as well as internal tooling to accelerate product development cycles;
● Learn and try new technologies, approaches and participate in bringing software engineering in this platform to the next level