Developing, testing, and deploying custom connectors for your data stores with AWS Glue

AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. AWS Glue already integrates with various popular data stores such as the Amazon Redshift, RDS, MongoDB, and Amazon S3. Organizations continue to evolve and use a variety of data stores that best fit […]

Performing data transformations using Snowflake and AWS Glue

In the connected world, data is getting generated from many different sources in a wide variety of data formats. Enterprises are looking for tools to ingest from these evolving data sources as well as programmatically customize the ingested data to meet their data warehousing needs. You also need solutions that help you quickly meet your […]

Biden’s first steps as president: Action on covid and climate

A flurry of executive orders is expected to take place over the next few days from the new US president as he takes residence in the White House. Here are the highlights of those he has signed so far. The “100 day mask challenge” Biden’s first order is part recommendation, part requirement: it requires people […]

University of Pisa leans into the I/O challenge AI applications create

At a time when workloads that employ machine and deep learning algorithms are being built and deployed more frequently, organizations need to optimize I/O throughput in a way that enables those workloads to cost-effectively share the expensive GPU resources used to train AI models. Case in point: the University of Pisa, which has been steadily […]

Building AWS Glue Spark ETL jobs by bringing your own JDBC drivers for Amazon RDS

AWS Glue is a fully managed extract, transform, and load (ETL) service that makes it easy to prepare and load your data for analytics. AWS Glue has native connectors to connect to supported data sources either on AWS or elsewhere using JDBC drivers. Additionally, AWS Glue now enables you to bring your own JDBC drivers […]

Allen Institute launches GENIE, a leaderboard for human-in-the-loop language model benchmarking

There’s been an explosion in recent years of natural language processing (NLP) datasets aimed at testing various AI capabilities. Many of these datasets have accompanying leaderboards, which provide a means of ranking and comparing models. But the adoption of leaderboards has thus far been limited to setups with automatic evaluation, like classification and knowledge retrieval. […]

Building fast ETL using SingleStore and AWS Glue

Disparate data systems have become a norm in many companies. The reasons for this vary: different teams in the organization select data system best suited for its primary function, the responsibility for choosing these data systems may have been decentralized across different departments, a merged company may still use separate data systems from the formerly […]

Hitman 1 and 2 players probably shouldn’t play Hitman 3 yet

Hitman 3 is the excellent culmination of developer IO Interactive’s modern trilogy of assassination simulators, but fans should probably hold off on playing it for now. That’s because IO’s website that carries the data over from the previous games is crashing due to a crunch of players. This prevents anyone with Hitman 1 or 2 […]

Migrating data from Google BigQuery to Amazon S3 using AWS Glue custom connectors

In today’s connected world, it’s common to have data sitting in various data sources in a variety of formats. Even though data is a critical component of decision making, for many organizations this data is spread across multiple public clouds. Organizations are looking for tools that make it easy to ingest data from these myriad data […]