{"id":2850,"date":"2022-05-19T11:40:27","date_gmt":"2022-05-19T06:10:27","guid":{"rendered":"https:\/\/www.urolime.com\/blogs\/?p=2850"},"modified":"2022-05-19T11:40:27","modified_gmt":"2022-05-19T06:10:27","slug":"google-cloud-to-remove-all-limits-of-data-with-biglake","status":"publish","type":"post","link":"https:\/\/www.urolime.com\/blogs\/google-cloud-to-remove-all-limits-of-data-with-biglake\/","title":{"rendered":"Google Cloud To Remove All Limits Of Data With BigLake"},"content":{"rendered":"

Google announced the creation of the Data Cloud Alliance initiative to help global enterprises experience digital transformation.<\/span><\/p>\n

The tech giant previewed its BigLake data lake storage engine and announced plans to remove data limitations through data lake and storage integration.<\/span><\/p>\n

According to Google “Managing data across multiple lakes and warehouses creates silos and increases risk and cost, especially when they need to move the data.\u00a0<\/span><\/p>\n

BigLake, a new cross-platform data storage engine\u00a0<\/span><\/h4>\n

With BigLake, Google hopes to consolidate data lakes and warehouses so businesses can analyze their data without worrying about the underlying format or storage system. It eliminates the need to duplicate or move source data, reducing costs and inefficiencies.<\/span><\/p>\n

Google Cloud customers can obtain access control through BigLake through APIs, including open file formats such as Google Cloud and Parquet, and open-source processing engines such as Apache Spark. The company says this capability extends a decade of innovation with BigQuery to data lake on Google Cloud Storage, enabling a flexible and cost-effective architecture for open lakes.<\/span><\/p>\n

Sudhir Hasbe, Product Manager for data analytics at Google Cloud, said BigLake will be central to the company’s overall strategy from a storage perspective.<\/span><\/p>\n

\u201cWe are going to make sure all of our tools and capabilities work seamlessly with BigLake,\u201d he said. \u201cSimilarly, all of our analytics engines, whether it’s BigQuery, whether it’s our Spark engine, or whether it’s our data flow engine, all of these engines will seamlessly integrate out of the box with BigLake.\u201d<\/span><\/p>\n

Google Data Cloud Alliance<\/span><\/h4>\n

The company also announced the creation of the Data Cloud Alliance<\/a>, a new initiative designed to enable global enterprises to access the data more seamlessly they need for digital transformation.<\/span><\/p>\n

The alliance includes Google Cloud, Accenture, Confluent, Databricks, Dataiku, Deloitte, Elastic, Fivetran, MongoDB, Neo4j, Redis, and Starburst. These companies say they are committed to making data accessible and portable across different systems, platforms, and business environments.<\/span><\/p>\n

Google Cloud says the proliferation of data means companies must increasingly work toward common digital data standards and open data to use it effectively for digital transformation.<\/span><\/p>\n

The Data Cloud Alliance is committed to accelerating the adoption of data analytics, artificial intelligence, and machine learning best practices across industries. Tech giant Vertex unveiled AI Workbench, which brings data and ML systems together in a single interface, enabling teams to share a common set of tools for data analysis, computing, and machine learning. It is designed to directly integrate all AI and data products, including BigQuery, Serverless Spark, and Dataproc.<\/span><\/p>\n

Alliance members work together to reduce customer concerns and complexity through data management, privacy, data loss prevention, and global compliance. It provides infrastructure, APIs, and integration support to ensure data portability and availability across platforms and products in multiple environments.<\/span><\/p>\n

Security Model<\/span><\/h4>\n

These guidelines apply to the following organizational roles:<\/span><\/em><\/p>\n

Data lake administrators (IAM) to manage Identity and Access Management policies, for Cloud Storage buckets and objects.<\/span><\/p>\n

Data warehouse administrators to create, delete, and update BigLake tables. To do so they requires the following IAM roles:<\/span><\/p>\n