Create New Account
Sign up to continue searching for suitable jobs in Web 3.0

OR
Terms of Use
Already have an account?

Log In to Your Account
Log in to continue searching for suitable jobs in Web 3.0

OR
Don’t have an account?
Mysten Labs
Lead Data Engineer
1 day ago | 25 views | Be the first one to apply

Lead Data Engineer

Full-time
United States, Remote
Per year
$160,000 To $240,000

About the company

We create foundational infrastructure to accelerate web3 adoption! Come join us! We are looking for researchers and engineers, product builders, entrepreneurs in fields spanning distributed systems, cryptography, compiler & VM, programming language, verification, and game theory.

Job Summary

Responsibilities:

šŸ“Design and implement scalable ingestion pipelines with a reusable and modular framework šŸ“Build robust, reusable frameworks to ingest data from internal sources (e.g., Prod DBs, cloud buckets, etc) and external APIs or files (e.g., CSVs, webhooks). šŸ“Ensure idempotency, backfill support, and error handling in pipeline design. šŸ“Optimize and own data warehousing, with clear table definitions, schemas, cost efficiency šŸ“Architect a centralized data lake/warehouse with clear schemas and partitioning strategies. šŸ“Support both batch and streaming workloads, and optimize for cost and performance. šŸ“Enable data discoverability, usability, and governance šŸ“Implement or integrate data cataloging and lineage tools šŸ“Define naming conventions, documentation standards, and ownership metadata to make data self-serve and intuitive for data scientists, analysts, and product / GTM teams. šŸ“Set up a mechanism for scalable access controls (with RBAC or ABAC), PII tagging, and data obfuscation. šŸ“Enable approaches for data quality checks, validation pipelines, and alerting for broken or stale data šŸ“Develop a strong understanding of how to use on-chain and off-chain data together

Required Qualifications:

šŸ“5+ years experience in data engineering šŸ“Strong SQL and Python šŸ“Strong and informed opinions on data orchestrators, catalogs, governance, and testing frameworks šŸ“Experience combining in-house and external data

If this role isn’t the perfect fit, there are plenty of exciting opportunities in blockchain technology, cryptocurrency startups, and remote crypto jobs to explore. Check them on our Jobs Board.

Similar jobs

1 day ago | 28 views | 1 applications
Full-time
Remote, Europe
1 day ago | 18 views | Be the first one to apply
1 day ago | 24 views | Be the first one to apply
Full-time
Hong Kong, Asia
$89,000 To $110,000 per year
1 day ago | 22 views | 1 applications
Full-time
Remote, United States
$112,000 To $189,000 per year
1 day ago | 20 views | 1 applications
$180,000 To $200,000 per year