![]() ![]() “Data mesh has transformed our mental model of what a thriving data ecosystem looks like,” she writes in the Medium piece. Nextdata will build tools that enable users to reach the full potential of a data mesh, according to Dehghani. She left Thoughtworks in 2022 and started work on a stealth startup, which we now know is Nextdata. During that time, Dehghani, who wrote the O’Reilly book on data mesh, has become a much sought-after speaker. The data mesh concept spread widely over the past couple of years as a potentially valuable pattern to help with the management and exploitation of big data. ![]() By enabling teams of developers to access decentralized data in a self-service manner with federated governance, they can take ownership of the data and build compelling products that scale, adhere to governance policies, and don’t perpetuate the chaos of the data pipeline world. Data producers spend their time on low-value processes–mostly moving data between systems–without ever fully considering how data can and should be used.”Īs we have previously written, Dehghani’s key insight was that data transformation cannot be hardwired into the data by engineers, but should work more like a filter applied against a common set of data. “This creates a compounding series of problems. “The value promised from data hasn’t been realized, primarily because today’s ways of managing data for analytics, AI, and machine learning were conceived in a paradigm where data was treated like oil: as a precious resource to be extracted, pumped via pipelines to a storage facility, processed, and consumed,” Dehghani writes in a Medium article. In place of that old-style of data management, a more agile and modern concept is needed, and that’s where Dehghani’s idea of the data mesh comes in. Instead, data will remain decentralized and exist in silos and will never be fully unified. The core ideas revolve around the knowledge that top-down centralization of data, vis a vis the data warehouses of old, is an impossibility in today’s massive and fragmented data environments. The new outfit will develop software designed to help customers implement “data product containers” that live in this data mesh environment.ĭehghani was the director of next tech incubation at Thoughtworks North America when originally conceived her ideas about the data mesh. ![]() Zhamak Dehghani, who is credited with popularizing the data mesh concept, announced earlier this month the founding of Nextdata. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |