Senior Data Engineer

Who we are:
Pillar is an Israeli and Ukrainian company. Since 2015, we provide outsourcing and out staff services to world-class companies all over the world.

Every day we partner across functional areas: logistics, medicine, education, tourism, game industry, utilities, data storage etc.
We work in a flexible environment where there is an opportunity to achieve results, receive feedback for learning, improve ways of working by developing both soft and hard skills, and contribute to a corporate culture focused on people.

Our team is highly experienced, all the projects we work on are solid and long-term as our clients appreciate our expertise and stay with us for long time.
We are also keen on learning from each other, that is why we cheerfully meet people who bring a new set of experiences and backgrounds to our team.

About the project:
Welcome to the world’s freshest food and beverage insights.
Tastewise fuels product, sales, and marketing innovation by getting innovative brands closer to their consumers. Using AI, Tastewise help the user measure and anticipate
how consumers cook, order, and eat.

No guesswork, no outdated reports – Tastewise AI equips exceptional food and beverage
brands with real-time insights.

Tastewise believe that shaping the future of food is crucial for the future of our planet.
Tastewise impact on the food industry is enormous and they just getting started.

They are reshaping the food & beverage ecosystem by reflecting people’s food and drink
consumption to the biggest manufacturers in the industry.

Tastewise love food, technology and data, and they changing the food & beverage industry for the better.

About the role:
At Tastewise, we’re passionate about food, technology and data. We give leading food and hospitality brands the tools they need to develop the next best line of products and dishes, equipping industry professionals to identify target segments and competitors, understand emerging trends, and determine which ingredients should be served next

We are looking for an innovative Senior Data Engineer that will join us and be part of our data team.

Tastewise team collects terra-bytes of data from multiple sources to analyze and derive valuable food related information for our customers!

If you are a hungry data engineer – we would be happy to meet you.

• What you’ll do:
•  Actively lead the availability, resilience, and scalability of our solutions by utilizing AWS cloud services.
•  Participate fully in team planning and work with colleagues to continuously improve the team’s performance.
•  Own your work from technical design, development, testing, deploying, maintaining and documenting.
•  Tackle tough problems and find creative ways to solve them.
•  Create ETL/Streaming processes to bring data to/from the data warehouse and other data sources.
•  Establish scalable, efficient, automated processes for large-scale data analyses.
•  Support the development of performance dashboards & data sets that will generate the right insights.
•  Work with business owners and partners to build data sets that answer their specific business questions.

What you’ll need:
Must:

•  Good level of English :B2 (Speaking and writing).
•  4+ years working as a Data engineer.
•  Experience working with AWS cloud services and big data technologies (EMR, EC2, S3, Glue, Athena, RDS).
•  Experience working with Spark.
•  Coding experience with Python / Javascript .
•  Great analytical skills and well versed with relational and document Based DB (NoSQL, preferably Elasticsearch).
•  All-around player, fast, self-learning individual.
•  Experience working on high scale, production-grade project.s
•  A developer by nature, technology enthusiastic with a sharp mind.
•  Collaborate with the rest of the engineering team to design and launch new features end-to-end.
•  Team player with an ability to work independently and good communication skills.
•  Can-do attitude!

Nice to have:

•  Experience working with Kafka – big advantage
•  Experience working with Airflow – big advantage
•  Experience working with Kubernetes – advantage
•  Experience working with Postgres – advantage