WHO ARE WE LOOKING FOR ?
Softway is on the lookout for a Data Engineer in Python who is passionate about building products that our customers love. You will join a dynamic and fast-paced environment and work with cross-functional teams to design, build and roll-out products that deliver the company’s vision and strategy.
We're seeking a Python-savvy Data Engineer with a growing interest in big data technologies to join our dynamic team. You'll use Python to build essential data pipelines, wrangle datasets, and collaborate with our data science team. This is a fantastic opportunity to gain experience with PySpark and other in-demand tools while contributing to our data-driven initiatives.
Responsibilities
Design and develop Python-based ETL/ELT processes, incorporating PySpark for larger datasets.
Clean, transform, and prepare data for analysis using Python (Pandas, NumPy) and PySpark.
Work with structured, semi-structured, and unstructured data from various sources.
Write SQL queries to effectively interact with relational databases.
Collaborate with data scientists and analysts to design and implement data solutions.
Explore and utilize cloud services for data storage and processing on AWS
Learn and contribute to best practices in data pipeline development and maintenance.
Required Skills:
Strong Python programming fundamentals and knowledge of core data manipulation libraries (Pandas, NumPy).
Basic understanding of PySpark for distributed data processing.
Proficiency in SQL for querying and working with relational data.
Familiarity with data warehousing and ETL/ELT principles.
Willingness to learn and grow within a collaborative environment.
Why Should You Work at Softway?
Softway offers a dynamic and collaborative work environment where you'll have the opportunity to work with talented individuals who are passionate about what they do. We provide ample learning opportunities and support career growth without unnecessary struggle. Our culture promotes open communication and values your opinions. We take pride in fostering an ego-less workforce focused on bringing innovative solutions to life. In addition to competitive compensation, we offer flexible work environments, paid time off, gratuity, and great flexibility.
Join us at Softway and be part of a team that works hard, plays harder, and continuously strives for excellence in everything we do!