To all our supporters — including clients, partners, associates, and more,

Since the founding of Hashmap in 2012, we have been on a mission to help clients adopt and leverage modern, data-driven solutions and AI applications that accelerated digital enablement and insights. The last 10 years have been full of victories (big and small) and opportunities for growth within our organization, especially in light of our acquisition by NTT DATA Services.

As a part of this journey to bring data and knowledge to all, Hashmap joined the community here on Medium in 2017. In the last 5 years that we’ve been writing on this platform, Hashmap has gained 3.5k followers, the HashmapInc publication has gained 1.5k followers, and the publication has featured articles from 20+ past and present Hashmap employees.

We are extremely proud of what we’ve accomplished here, and how we’ve helped our clients — ranging from startups to Fortune 500 organizations in financial, healthcare, energy, technology, and other industries — establish trusted data foundations and applications for digital transformation.

Together as NTT DATA Services — a top 10 digital business and a leader in IT services — we’re able to offer even more capabilities and services to our community of clients and partners (like Snowflake, Atlan, Fivetran, Matillion, and more!), and we’re excited about the future that lies ahead.

As one door closes, another one opens, and as such, this will be our final post on Medium. But — don’t worry — you’ll be able to find the same (great) content on NTT DATA’s blog and social media channels. Keep reading for more about NTT DATA Services, and follow us on LinkedIn, Facebook, Twitter, YouTube, and Instagram.

New Global Reach

As modern, data-driven cloud solutions continue to rapidly expand, clients are asking for the ability to support their organizations across the enterprise and around the globe. With vast experience in scaled global delivery, NTT DATA Services can meet those needs.

An Expanded Portfolio

There are perks of working with a top 10 global IT services provider, and as an NTT DATA Services’ client, you can benefit from the increased depth of available resources and expertise that we have to offer — like a full suite of transformative technology solutions and flexible support models that are all enabled by automated and intelligent digital workflows.

Deeper Innovation Resources

The NTT Group invested about $3.68 billion in R&D last year and has 5,000 research professionals at dedicated R&D facilities worldwide. Clients can benefit from NTT DATA’s impressive (and innovative) digital portfolio that’s made up of leading-edge technologies powered by AI, automation, and the cloud, data and intelligence, customer experience, security, and operations.

Broader Impact on the Market

It’s imperative to grow and evolve in response to both client demand and an evolving business environment. As a part of the Digital Transformation team at NTT DATA Services, we will continue to empower clients and support broader mission-critical business digitization efforts so you and your teams can meet today’s accelerating challenges.

Check out our latest blog here:

An Inside Look at NTT DATAs Cost Optimization Service For Snowflake COSS

P.S. Make sure you scroll down to the bottom of the blog and subscribe (see the below image) for updates delivered straight to your email inbox!

Looking to the future…

Thank you — again — for all the support. As new technologies, data, and cloud challenges continue to evolve, we look forward to continuing to enable and support our clients and partners — just as we always have.

We continue to remain grateful for and humbled by the trust and support of each of our clients, partners, and the broader community, and we’re excited about what we can deliver as a part of NTT DATA Services.

Signing off,

Hashmap, an NTT DATA Company

Hashmap, an NTT DATA Company, Says “Farewell” to Medium was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

Hashmap on Tap Ep. 130

“How do we as humans move away from intuition-based decision making to actually more fact and information-based decision making?” — Manish Jethani, Co-Founder and CEO at Hevo Data

Manish Jethani, Co-Founder and CEO at Hevo Data, joined us for an episode of Hashmap on Tap to talk about how they empower customers through a no-code, intuitive data pipeline. They have 100+ pre-built integrations across databases, SaaS applications, cloud storage, SDKs, and streaming services to be able to provide customers with a fully automated and reliable data pipeline. Over a cup of coffee, Manish walks through how Hevo Data started and how they’re providing this incredibly fast and simple way to get your data into your warehouse.

“That’s where I started seeing that this is a big problem, that most people who want to take decisions looking at the data, really don’t have access to the data. . . We thought that what if we could really solve this problem to a point where the users within the organization who need to use data to make decisions don’t have to rely on the engineering team? I think that was the very core to what we’ve done ever since that, how do we really make it simple, intuitive, so that eventually everyone should be able to use that?” — Manish Jethani, Co-Founder and CEO at Hevo Data

Hear Manish’s perspectives on:

• How to align everyone within an organization to use data in all of their decision-making
• Potential Integrations with Hevo Data and how they prioritize them
• How they facilitate client community feedback for Hevo Data
• Why he says their product’s flexibility and usability are unmatched
• Hevo Data’s unique pricing model
• The most difficult aspects of raising $43 million in funding
• How the history of the technology starts with feasibility and ends with accessibility

Listen to the episode:

Hashmap on Tap | Hashmap Podcast

Related Resources:

• Data Integration Workshop | Hashmap
• 5 Reasons Why I’m Paying Attention to Data Governance (And You Should Be, Too)
• Women in Data Governance Roundtable with TD SYNNEX, Monte Carlo, & Matillion
• Back to the Basics of Everything Data — Technology Expansion, Snowflake, and the Modern Data Cloud

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Hevo Data — Taking the ‘Heave ho’ Out of Data Pipelines with Manish Jethani Co-Founder and CEO at… was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

You may have caught our recent update on Fivetran’s Teleport Sync, a feature that allows for a “faster method for dataset comparison.” If you found yourself wanting even more, then you’re in luck! Fivetran recently held a quarterly product showcase which gave viewers a peek at what we can expect to see from them over the next few months.

A Look Back on Last Quarter

The product showcase kicked off with a quick recap of what we saw in Q2, including both new and upgraded connectors, including beta connectors for Amazon Ads and Salesforce Commerce Cloud. They also discussed their High Volume Agent Connectors, which come following their recent acquisition of HVR and enable users to “minimize source load so data teams can realize faster setup times, limit maintenance and handle higher volumes and data structure changes.” They then touched on Teleport Sync, which you can again catch up on here, as well as announced that Metadata API went from private preview to being moved into beta. Finally, the last Q2 recap was on Fivetran Transformations, which will remain a free feature that will “orchestrate custom data transformations in your destination.” Now, on to what’s to come!

Coming Up This Quarter

We can expect to see even more changes and updates in data connectors & destinations, transformations, and governance & security in Q3. First, those beta connectors for Amazon Ads and Salesforce Commerce Cloud that were mentioned earlier will be moving from beta to general availability. Joining them on that move to general availability will be Sage Intacct, ADP Workforce Now, and SAP Business By Design. There will also be a number of new connectors in development, among them being Bamboo HR, Yahoo DSP, Spotify Ads, Google Search Ads 360, and more.

They’re also working more with High Volume Agent Connectors this quarter, with HVA SQL Server launching in private preview. In development will be agent-initiated connections, HVA SAP (PP), and HVA DB2i (PP).

Business Critical Fivetran, their “highest level of data protection and compliance,” will also be seeing some updates this quarter. They will be adding more high security on Google Cloud, which is currently unavailable but will be made available this quarter. Features that have been popular on Snowflake and AWS, like private networking, cloud region support, and the security of PCI DSS Level 1 will soon be seen on Google Cloud. We’ll also be seeing some new metadata catalog integrations with data.world, Collibra, and our other partners Alation and Atlan!

Another upcoming update will be with Transformations, with a Quickstart package coming to private preview this quarter. This will “set up model runs without touching a single line of code” and take data from its raw state to being ready for analysis even faster. There will also be new pre-built data models — coming soon will be Apple Search Ads, Amplitude, Databricks compatibility with models, and Recurly.

Currently, Fivetran has Amazon S3 as a source, but coming soon we will see S3 as a destination as well. During the showcase, they introduced S3 with Iceberg, which will offer a modern data lake with S3 and provide extensive data governance. This private preview will go live in September!

These were all of the new features and updates we can expect to see this quarter, but we did get a bit of a teaser for a new feature they have been working on for the past year. This feature is building connectors by request, which differs from the way they currently build their connectors. At present, customers can let Fivetran know what they’d like to see, and they take those suggestions and process them, then narrow it down and that connector might be made available a few months down the road. They’re looking into making it a possibility for customers to ask for the connector they need, offer to share access to it can be built, and Fivetran makes this happen in somewhere closer to 45 days. Be on the lookout for more updates on this offer!

Upcoming Events

If you want to stay in the loop with Fivetran, there are a couple of upcoming events that you can check out! There is an upcoming webinar on Wednesday, August 31, 2022, on Modernizing your data lake with Fivetran, Amazon S3 and Apache Iceberg. They also have a monthly virtual event, Hands-On Lab: Fivetran Transformations for dbt Core, with the next one landing on Thursday, September 8th, 2022!

Hashmap and Fivetran

We are happy to be partners with Fivetran! We offer Fivetran Custom Connectors, which you can find more about here. We’ve also featured a few people from Fivetran on our podcast, Hashmap on Tap, like George Fraser, CEO and Co-Founder of Fivetran, to learn more about the company. We also have a number of recorded webinars and demos available! You can check all of those out and more (like blog posts and solution profiles) here. If you want to go ahead and get started with Hashmap and Fivetran, get in touch with us!

Additional Resources

• Fivetran’s Teleport Sync is Here!
• Developing Your First Fivetran Function Connector with AWS SAM & Snowflake
• Data Integration, Fivetran, and HVR at Powell Industries with Ajay Bidani
• Extracting Facebook Insights via Fivetran and Snowflake

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Fivetran’s Upcoming Features and Updates for Q3 was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

“[The] database is the foundational piece for everything.”

- Richie Bachala, Principal at Yugabyte

If you’ve been keeping up with the Hashmap on Tap podcast for a while, you may remember catching Richie Bachala on episode #61 early last year. While on the podcast, he discussed his experience at Sherwin-Williams and migrating from Oracle to Snowflake. Having Richie on the podcast was such a great time, so we decided to go ahead and bring him back on!

That’s right, Richie’s back for another recent episode of the podcast. Since we last spoke, he’s made a move from Sherwin-Williams to becoming a Principal at Yugabyte, a distributed SQL database built to power global-scale, cloud-native applications. Yugabyte is an open-source option that is scalable, resistant, and consistent, accessible anywhere you are. On tap for this episode is a combination of unsweetened black tea and Sanpellegrino for Richie and a bulletproof coffee with A2 half and half for host Kelly Kohlleffel.

Fun fact: Cows produce A1 protein and A2 protein in their milk, and the A2 protein can be easier for us to digest. Who knew?

One of the main topics of discussion for this episode was a recent blog post of Richie’s, Building a Data Engineering Center of Excellence. Richie has been working with data teams for years, so he knows what a data team needs to succeed. One of the key points in this blog post is the six pillars of responsibilities of a data engineering team, so be sure to check out the full blog for those pillars and a high-level overview of what he sees as a necessity when building that team.

On the podcast, Richie also touches on the need for companies to quickly hop on board for a digital transformation journey. During the pandemic, flexibility has become a huge necessity, and with that comes the need for digital transformation. A great benefit to this transformation has been the positive impact it has had on companies’ sustainability goals, which has been another main focus in the past couple of years. He mentions the recent COP26 conference in Glasgow as being a big part of that shift to focusing on sustainable solutions.

Make sure to check out the full episode to catch up with Richie and hear more about his new journey with Yugabyte, which has already been an extremely positive experience for him so far. You can also join the Yugabyte Slack community to learn more!

Hear Richie’s perspectives on:

• Two big trends he sees on the forefront of every C-suite executive’s agenda
• A centralized vs. decentralized data approach
• Auto ML and AI tools that are catching his eye
• Whether or not a company needs data scientists
• The benefits of Yugabyte being an open-source tool

Listen to the episode:

Hashmap on Tap | Hashmap Podcast

🚨Subscribe to Hashmap on Tap on Spotify, Apple Podcasts, & Google Podcasts.🚨

Additional Resources:

• Building a Data Engineering Center of Excellence
• Why is Open-Source Important to the Market?
• Four Hashmap on Tap Guests Named Snowflake Data Superheroes
• Demystifying the Secrets of Data Mesh with Snowflake’s Kent Graziano
• Answers to Common Snowflake Questions

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

The Pillars of Data Engineering with Richie Bachala at Yugabyte was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

“Data observability is more about giving users the ability to analyze why a certain problem happen. . . The metrics you monitor are one piece of information, but there can be a lot more.”

— Maarten Masschelein Co-Founder of Soda

Maarten Masschelein joined us recently on an episode of Hashmap on Tap to tell us more about his company, Soda — how they got started and their plans for the future. Maarten is co-founder and CEO at Soda, a Belgium-based open-source data observability and monitoring platform for the modern data stack. They will help you address data quality and data trust, two significant issues. Prior to founding Soda, Maarten spent a number of years with Collibra as one of the first five employees.

So how does one go from Collibra to starting their own open-source data observability tool?

Maarten was one of the first five employees at Collibra and the first employee in the go-to-market organization. At the beginning of any software startup, you have a few employees doing all of the work. Each member of the team plays a pivotal role in the direction of their product as you quickly broaden your skillset. Maarten was fortunate to learn a lot from the team and founders of Collibra while learning various roles during his six years there. After six years, the question that prompted Maarten to start his own project was “How can I apply myself from what I’ve seen and learned?”

There is a lot to learn from how a startup operates, especially one that has been as successful as Collibra has been in these early years. Maarten found that the way teams are organized and their dynamics were a key takeaway over the specific roles and responsibilities. His mindset shifted because of Collibra to see that data management as a solution that solves many different problems and use cases instead of just a technology.

How would Soda be set apart from others?

One thing that Maarten has noticed from software companies over the years is that they are difficult to start using or make it difficult for the technology to help you immediately. There’s traditionally a lengthy commercial process involving demos and RFPs, but using the software happens after the software is purchased. Maarten saw this as an inefficient process when there are components that can provide immediate value to an individual user. This is why Maarten and his co-founder Tom, decided on an open-source approach. Anyone can start using Soda’s open-source offering today, integrate tools, and contribute code. This approach allows users to get their hands on the technology, removing risks by not providing a small trial-type service.

How does a community play into shaping a new startup like Soda?

Soda has a fantastic open-source community. Software engineers and developers love contributing to open-source projects because it helps them create a more public profile. It helps them help other people while they can play with the technology and implement it in their own organization. As part of their growing community, Soda also has a fantastic Slack community. Contributors and their community add to the depth of Soda and demonstrate the diversity of use cases that it can be applied.

Where is Soda today?

The team at Soda is about 40 strong, spread across Europe and the US. This team has been initially focused on the open-source capabilities and making sure that they had a simple, easy-to-pick-up solution that provided a solid foundation for a framework of quality and reliability management in organizations. Data scientists are looking to add capabilities to their data platform and self-serve capabilities. Soda provides a flexible and simple solution that data scientists can immediately put to use.

As the team continues to grow, the team at Soda is looking to make it even easier for their community to contribute to the framework.

Listen to the episode to hear more from Maarten about his perspectives on data observability and about Soda and their open-source community.

Listen to the episode:

Hashmap on Tap | Hashmap Podcast

🚨Subscribe to Hashmap on Tap on Spotify, Apple Podcasts, & Google Podcasts.🚨

Additional Resources:

• Hashmap | Data Governance Resources
• Atlan —  the First and Only Modern Data Workspace for Snowflake Data Cloud
• Back to the Basics of Everything Data — Technology Expansion, Snowflake, and the Modern Data Cloud
• 5 Reasons Why I’m Paying Attention to Data Governance (And You Should Be, Too)

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

How to Bypass a Free Trial and Start Delivering Value through Open-Source Solutions with Soda was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

“One thing that we have learned is that it’s much better to find the customers that fit into your niche — rather than trying to satisfy every single customer. . . It’s better to say ‘no’ to customers [in order to] focus on the core value problem and fine-tune your value to the existing customer.”

— Aayush Jain

Imagine that it’s 1995, and you’re on a road trip. You’re about halfway to your destination, and you realize it’s been a while since you last stopped for gas. You glance down at your car’s dashboard to check your gas level and see that the needle is in the red — you’re about to run out of gas. You start to panic and look for the next highway exit with a gas station so you can fill up — while thinking to yourself, “Wow, I looked down at just the right time…it really would have been great for the car to give me some kind of heads-up…”

Fast forward to the present — many of today’s modern cars have reliable alert capabilities. In most cases, you can rely on the car to alert you — typically with a beep or a message on the dashboard — when your gas level is low, maintenance is required, what road to turn on next, or even if a collision is detected. Due to the nature of these alerts, it’s incredibly helpful for the car (and its systems, dashboards, etc.) to be reliable.

With the advances in these types of features, you can rely on more than just yourself to avoid experiencing issues or delays. Aayush Jain is no stranger to the concept of reliability when it comes to running a business, and he offers valuable advice on this topic as a guest on a recent episode of the podcast, Hashmap on Tap.

What’s on tap for this episode? Tea! Aayush is drinking what he calls “grandma’s tea” — an iced, Indian medicinal tea that your grandma might serve you when you’re feeling under the weather (hence where the name comes from!) Kelly is drinking a fruity, hibiscus tea with a hint of lemon cream honey that complements the flavors without making it too sweet.

Aayush is the Founder and CEO of Cliff.ai, and over tea, he shares how Cliff.ai is helping clients monitor business reliability to help find and fix business issues as they are happening by using data. Prior to Cliff.ai, Aayush founded multiple other companies including Greendeck and TrueMD.

“Imagine physicists and biologists not enjoying their science degrees and wanting to do something else. The only common thing that we found together was computer science.”

— Aayush Jain

So where did Aayush begin his journey and how did he become interested in technology? Well, Aayush reveals that his background is actually in biology, and he got into tech as a distraction from his science degree since he “absolutely hated it.” The other two co-founders of Cliff.ai are Aayush’s college friends and former roommates, and they both come from similar backgrounds with degrees in physics. Like Aayush, they were looking for the opportunity to do something new.

Their first company, TrueMD, offered users generic alternatives to medicines to help cut down healthcare costs, and it progressed from a platform to a full-fledged pharmacy. After TrueMD was purchased, the co-founders began brainstorming ideas for the next problem to be solved, and as a result, they landed on pricing. The idea for Greendeck, which began in 2017, was to help online fashion retailers make better pricing decisions with the use of AI. What began with just 3 co-founders grew into a team of 22 people. Now, Greendeck and Cliff.ai operate as one company, but with two different products.

While business reliability is their ultimate outcome, Cliff.ai is fundamentally solving the problem of dashboards. The dashboard relies on a person to be able to continuously look at the metrics for making decisions, which is unsustainable. To improve the functionality and reliability of the dashboard, Cliff.ai notifies users about marketing metrics and notes unprecedented spikes. Additionally, Aayush discusses how Cliff.ai utilizes three principles to reduce the number of alerts the end users are getting.

Aayush also offers insights into the customer base that can derive the most benefit from Cliff.ai’s technologies. As he explains, the customers who see the most value in the platform are the ones who already have a data warehouse in place. For that reason, Cliff.ai is focusing on cloud data warehouse integrations.

Want to know what tip they’ve learned when it comes to building a customer base? Aayush shares the insight that it’s preferable to find customers who fit into the company’s niche rather than trying to satisfy everybody. Cliff.ai certainly understands what it takes to grow a customer base — their company’s growth has been completely organic, and they’re now receiving over 45,000 visitors on a monthly basis.

As the episode wraps up, Aayush discusses the new interesting side project his team has been working on. Additionally, due to their company’s growth, Cliff.ai is currently hiring, and Aayush describes the qualities that make up their ideal engineering hire. Want to find out what they’re looking for (and more!)? Make sure you listen to the full episode below!

Listen to the episode:

🚨Subscribe to Hashmap on Tap on Spotify, Apple Podcasts, & Google Podcasts.🚨

Additional Resources:

• Innovation: Building an API in Azure for the Snowflake Data Cloud
• Diagnosing the Problem with Centralized Data with Omar Khawaja, Head of Business Intelligence at…
• Diagnosing the Problem with Centralized Data with Omar Khawaja, Head of Business Intelligence at…

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Navigating the Road to Business Reliability with Aayush Jain of Cliff.ai was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

“You need to think about privacy whenever you start to collect data in this, what we call, shift left concept — you need to shift left with privacy inside your data pipeline or inside your data stack before you do anything else.” — Pim Nauts, Co-Founder of STRM Pirvacy

Do you ever feel like you’re sacrificing innovation for privacy? Pim Nauts is Co-Founder and Robin Trietsch is a Founding Engineer at STRM Privacy, a Dutch startup, where they are delivering privacy-by-design data pipelines from data collection all the way to storage and consumption helping to decrease privacy risk, remove coordination time between legal and data, and increase data outcome velocity. Pim and Robin joined us on an episode of the Hashmap on Tap podcast to discuss how they are helping clients make data pipelines secure from the beginning and taking in data that meet the privacy standards.

On tap for this episode are beers from a local, Dutch monastery brewery, Brewery de Koningshoeven. They’ve been brewing beer since the end of the 19th century. The beers Pim and Robin chose are very unique beers as they are the only Witte Trappist and the only non-alcoholic Trappist in the world.

Hear Robin and Pim’s Perspectives on:

• How STRM Privacy fits into a modern data stack
• How they work with different industry-specific, privacy and security requirements
• The importance of scalability within their architecture
• The different types of privacy streams they can create
• Why they chose Kafka as their event processing entity
• How they manage data quality and validation in the context and scope of STRM Privacy

Listen to the episode:

Hashmap on Tap | Hashmap Podcast

Related Resources

• 5 Reasons Why I’m Paying Attention to Data Governance (And You Should Be, Too)
• HL7 Processing & Transformation with Snowpark Python and Snowflake
• Hashmap | Data Governance Resources
• Paving the Way for Privacy Engineering with Danielle Beringer from Gretel.ai

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Innovation Without Sacrificing Data Privacy with Pim Nauts & Robin Trietsch from STRM Privacy was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

“The more complex the data, the better fit they are for Coalesce.”
- Armon Petrossian, CEO and Co-Founder at Coalesce

When you have your raw data, how much time is spent taking it from its raw state to being consumable, accurate, and governed? If you thought “too much time”, you’re not alone! Many organizations struggle with preparing data properly at scale, and Coalesce is passionate about solving this problem.

Coalesce is a code-first, GUI-driven data transformation solution that is architected for scale, is column aware, has native git integration, and provides automated documentation. On a recent episode of Hashmap on Tap, Armon Petrossian, CEO & Co-Founder of Coalesce, joined host Kelly Kohlleffel to chat about how they’re solving this problem, especially with their partnerships with Snowflake and Fivetran.

Before we get further into the data world, we must discuss what’s on tap for this episode. Armon is doubling up with the same combination he enjoys on most weekday mornings, a black coffee and a Spindrift. Kelly also chose to double up, but with Bulletproof coffee and decaf Nespresso.

Armon first noticed the problem that came with data transformation during his time at WhereScape, which is actually where he met his Coalesce Co-Founder, Satish! They were exposed to data warehouses on a grand scale and noticed that a common problem among all of these different organizations was their data transformation. When leaving their roles, they knew what the market needed, and they got to work on making it happen.

Check out the episode to hear more about their time in stealth building Coalesce and what their ideal customer would be!

Hear Armon’s perspectives on:

• Why Coalesce’s integration with Snowflake was a must
• How more departments in more organizations have data people on their teams
• How quickly anyone can be productive with Coalesce
• The importance of creating a company culture that will not just get people to join the team, but to stay and grow with it
• His favorite Italian restaurant in North Beach and what dish he recommends

Listen to the episode:

Hashmap on Tap | Hashmap Podcast

🚨Subscribe to Hashmap on Tap on Spotify, Apple Podcasts, & Google Podcasts.🚨

Additional Resources:

• Back to the Basics of Everything Data — Data Culture, Data Integration, and Snowflake’s Data Cloud
• Coming Soon: Snowflake Unistore!
• HL7 Processing & Transformation with Snowpark Python and Snowflake
• The Origins and Future of Fivetran with George Fraser

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Making Data Transformation a Breeze with Armon Petrossian, CEO & Co-Founder of Coalesce was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

Democratize your data with cataloging, governance, lineage & more

Atlan and Snowflake have been technology partners since 2021, but they recently made a big announcement — Atlan is the first and only data catalog to be validated as a Snowflake Ready Technology Partner!

Atlan is focused on collaboration, documentation, and usability so that data teams spend less time finding and understanding data and can focus on business outcomes and teamwork. Their “Modern Data Workspace” has been rapidly attracting Snowflake’s customer base with key components such as a Data Catalog, Data Quality/Profiling, Data Exploration, and Data Lineage.

“As Snowflake continues to help companies mobilize their data, Atlan makes it possible to find, use, document, and collaborate on this data. Our partnership with Atlan was a natural fit, given how its open approach, pay as you go model, and delightful user experience align with Snowflake’s own ethos.” — Tarik Dwiek, Head of Technology Alliances at Snowflake

Atlan + Snowflake = A Match Made in Data Team Heaven 💙 🤝💙

So what is so special about Atlan and Snowflake’s partnership? Together, they are constructing a joint roadmap to continue building the integration between their platforms.

“We generate lineage at an individual column level in Snowflake and can extend this to BI tools like Looker and Tableau — all as a native capability. We are making significant investments into our joint roadmap with Snowflake, and we can’t wait to usher customers into the data governance 3.0 era together.” — Prukalpa Sankar, Co-founder, Atlan

With Atlan, you can democratize your Snowflake Data Cloud with cataloging, governance, lineage & more.

• Data Catalog & Discovery for Snowflake: Make all of your data assets on Snowflake and other sources immediately discoverable. Atlan provides a self-service search and browse, easy access control, and a searchable business glossary.

• Data Lineage & Governance for Snowflake: Atlan’s data catalog for Snowflake simplifies governing and managing your data ecosystem. Atlan’s bots parse through SQL query history to auto-construct data lineage and auto-detect PII data — this allows you to create dynamic access policies & best-in-class governance.

• Data Exploration & Integrations with Snowflake: Non-technical users can directly query across multiple data lakes and Snowflake using Atlan’s Excel-like query builder. They have native integrations with tools like Tableau, PowerBI, and Jupyter.

You can also check out this webinar where Prukalpa Co-founder, Atlan, and Jeremy Maranitch Senior Alliance Manager, Snowflake, demystify the Modern Data Platform and talk about how to get up and running with your modern data platform in under two hours!

Atlan is unveiling a complete redesign and slate of new integrations, capabilities, and partnerships to help data teams activate their metadata. You can read more about these new features here and attend their Product Townhall 2022 for more info.

But . . . How Do I Know if Atlan is the Best Data Governance Tool for My Team?

At Hashmap, our job is to be the data experts. We research companies and solutions to make sure the right tools are used for the right projects. Our goal is to share as much of that research with the community to ensure you can make those same informed decisions and be able to easily filter through the noise. Connect with our team for a 1:1 review of the Data Governance Tools Comparative Analysis which features Atlan, Alation, and DataHub. This analysis will help you understand which tool is best for you to implement in your data pipelines.

Hashmap | Data Governance Resources

Additional Resources to Help You Get Started

If you’re just getting started in the data governance space, I recommend you check out Kelly’s blog posts below where he dives into some of the most common data governance questions and provides some proven resources you can use to update yourself on modern technologies and approaches like Atlan.

• 5 Reasons Why I’m Paying Attention to Data Governance (And You Should Be, Too)
• Are These 4 Companies on Your Radar for Data Governance?

Watch this Atlan and Snowflake demo where Lead Data/Cloud Engineer at Hashmap, Jalindar Karanda, demonstrates, step by step, how to integrate Snowflake with Atlan. You can also find our playlist of Atlan demos here and Snowflake demos here. We publish new videos every week so subscribe to keep up!

The DataOps Culture Code is part of Atlan’s documentation and they describe their process of creating it as, “We experimented for two years, across 200 data projects, to create our own viewpoint of what makes data teams successful. We’ve codified these learnings into what we call the “DataOps Culture Code”. Within their learnings, Atlan explains that there is no easy answer to making data teams successful and collaboration is key, “Data teams will always have a variety of roles, each with their own skills, favorite tools, and DNA. Embrace the diversity and create mechanisms for effective collaboration”. Find out more about Altan’s learnings here:

The DataOps Culture Code

I also highly recommend subscribing to Atlan’s newsletter, Metadata Weekly. Each week, we look forward to reading the perspectives of Prukalpa, Co-Founder at Atlan. In the newsletter, Prukalpa curates her recommended reads and shares her thoughts on everything around the modern data stack and metadata.

Metadata Weekly | Prukalpa | Substack

You can even hear Prukalpa on an episode of our Hashmap on Tap podcast. Prukalpa takes us through her role at Atlan, the core tenets of a modern collaborative data workspace, and what it means to think about data as a product instead of a service. Listen to the episode here:

Hashmap on Tap | Hashmap Podcast

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Leah Hudson is a Senior Marketing Analyst at Hashmap, an NTT DATA Company, and co-produces the Hashmap on Tap Podcast.

Hashmap on Tap | Hashmap Podcast

Atlan —  the First and Only Modern Data Workspace for Snowflake Data Cloud was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.

Do you remember June of 2021? A lot may have happened, but there’s one moment in particular that we’re going to focus on today. That moment, of course, is Fivetran’s acquisition of Teleport Data “for database replication that offers the completeness of snapshots while approaching the speed of log-based systems.” This acquisition came about as an attempt to solve the problem of tracking changes in data and ensuring data quality and consistency when transferring data from its source location to a warehouse.

There have been some attempts to solve this problem, which you can read more about here in the blog post from Fivetran that announced this acquisition last year. Ultimately, those solutions had drawbacks that could be deal-breakers for data teams. With this acquisition, a new solution was on the horizon, one that would allow teams to move only changed data, and to do so without requiring bin log access.

Well, we’ve got great news! That solution is here, and it’s being rolled out for MariaDB, MySQL, Oracle, PostgreSQL, and SQL Server. They’ve been working on this for the past year now, and Hashmap is excited to see it come to fruition. Fivetran’s teleport sync is a “faster method for dataset comparison” that gets its name from that acquisition of Teleport Data. The name may be a callback, but the technology is new and offers the ability for teams to replicate databases and allow read-only users to access them. Users on either a trial or full version of Fivetran have access to this feature! You can read more about the release directly from Fivetran here.

Hashmap and Fivetran

We at Hashmap are proud partners with Fivetran! We offer Fivetran Custom Connectors, which you can find more about here. On our podcast, Hashmap on Tap, we’ve had the joy of speaking with a few people from Fivetran (like George Fraser, CEO and Co-Founder of Fivetran) to learn more about the history of the company, where they’re going, and how they work together to solve problems. We also have a number of recorded webinars and demos available! You can check all of those out and more (like blog posts and solution profiles) here. If you want to go ahead and get started with Hashmap and Fivetran, get in touch with us!

Additional Resources

• Developing Your First Fivetran Function Connector with AWS SAM & Snowflake
• Extracting Facebook Insights via Fivetran and Snowflake
• Data Integration, Fivetran, and HVR at Powell Industries with Ajay Bidani
• The Origins and Future of Fivetran with George Fraser

Ready to Accelerate Your Digital Transformation?

At Hashmap, an NTT DATA Company, we work with our clients to build better, together. We are partnering with companies across a diverse range of industries to solve the toughest data challenges and design and build data products — we can help you shorten time to value!

We offer a range of enablement workshops and assessment services, data modernization and migration services, and consulting service packages for building new data products as part of our service offerings. We would be glad to work through your specific requirements. Connect with us here.

Fivetran’s Teleport Sync is Here! was originally published in Hashmap, an NTT DATA Company on Medium, where people are continuing the conversation by highlighting and responding to this story.