Create and build data pipeline architecture for optimal data collection.
Collaboration with the technical team (software engineers and data scientist) to ensure optimal data delivery which is consistent throughout ongoing projects.
Strategize and create web crawling tools
Identify, design and implement internal process improvements such as automating manual processes, data delivery and re-designing cloud infrastructure for greater scalability.
Build the infrastructure required for data extraction, transformation and loading (ETL) from a wide variety of data sources using SQL, NoSQL, or unstructured data technologies.
Work with stakeholders including C-Suite and tech team to assist with data-related technical issues and support their data infrastructure needs.
Create data tools for analytics and assisting data scientists in building and optimizing our product into an innovative leader.
Bachelor’s degree required with at least 2 – 3 years of experience in a Data Engineer role, who has attained a degree in computer science, electrical engineering, informatics or any other quantitative field.
Advanced working knowledge of SQL and experience in relational databases, as well as working familiarity with a variety of other NoSQL technologies (MongoDB, HBase, DynamoDB, Cassandra, Redis, Neo4J, etc).
Experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
Strong analytic skills related to working with unstructured datasets.
Experience with big data tools: Pytorch, Spacy, Hadoop, Spark, Kafka, etc.
Experience in different scripting languages: Python, Java, C++, Scala, etc.
Experience in building processes to support data extraction, transformation, loading (ETL) and AWS cloud services.
History of manipulating, processing and extracting values from large disconnected datasets.
Highly motivated and self-directed individual who is excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of product and data.
This position is only open for Malaysian. For those who interest, please email your resume and title to be indicated as "Application for ________”