Why your governance team should be excited about Microsoft Fabric

On May 29, 2023May 29, 2023 By Matthew RocheIn Data Culture, Data Governance, Fabric, Power BI1 Comment

Microsoft Fabric has only been in preview for a week, and I’ve already written one post that covers data governance – do we really need another one already?

I think we do.

Over the weekend I got this reply via Mastodon.

Dave’s excellent question and comment^[1] got me thinking about why OneLake feels so important to him (and to me) even though Fabric is so much more than any one part – even a part as central as OneLake. The more I thought about it, the more the pieces fell into place in my mind, and the more I found myself thinking about one of my favorite quotes^[2]:

A complex system that works is invariably found to have evolved from a simple system that works. The inverse proposition also appears to be true: A complex system designed from scratch never works and cannot be made to work.

Please take a minute to reflect on this quote. Ask yourself if Fabric is a complex system that works, what is the simple system that works? We’ll come back to that.

One of the most underappreciated benefits of Power BI as a managed SaaS data platform has been the “managed” part. When you create a report, dataset, dataflow, or other item in Power BI, the Power BI service knows everything about it. Power BI is the authoritative system for all items it contains, which means that Power BI can answer questions related to lineage (where does the data used by this report come from?) and impact analysis (where is the data in this dataset used?) and compliance (who has permissions to access this report?) and more.

If you’ve ever tried to authoritatively answer questions like these for a system of any non-trivial scope, you know how hard it is. Power BI has made this information increasingly available to administrators, through logs and APIs, and the community has built a wide range of free and paid solutions to help admins turn this information into insights and action. Even more excitingly, Power BI keeps getting better and better even as the newer parts of Fabric seem to be getting all of the attention.

With Power BI, more people can work with more data in more of the right ways to make more data-driven business decisions, taking more actions that align with the goals and culture of the organization.

What what does all this have to do with Fabric and OneLake and simple systems?

For data governance and enablement, Power BI is the simple system that works. OneLake is the mechanism through which the additional complexity of Fabric builds on the success of Power BI. Before the introduction of Fabric, the scope of Power BI was typically limited to the “final mile” of the data supply chain. There is a universe of upstream complexity that includes transactional systems, ETL/ELT/data preparation systems, data warehouses, lakes, and lakehouses, and any number of related building blocks. Having accessible insights into the Power BI tenant is great, but its value is constrained by the scope of the tenant and its contents.

With Fabric, that scope of value is significantly increased. Fabric includes tools and capabilities for significantly more parts of the data supply chain, and whatever you do in Fabric is part of the same tenant, which means these insights are more readily available. In addition to what you know and love in Power BI, Fabric also includes a growing set of governance-focused capabilities that make it easier than ever to monitor and audit artifacts and activities, and to implement guardrails to help everyone achieve their business goals in ways that align with the organization’s governance strategy.

All Fabric workloads use OneLake as their default data location. OneLake represents the biggest single step forward in moving from simpler to more complex, because it is the big expansion in the SaaS foundation shared by all Fabric workloads new and old. Because of Fabric, and because OneLake is the heart of Fabric, governance teams can now get more of the things they love about Power BI for more parts of the data estate.

Why should your governance team be excited about Microsoft Fabric? They should be excited because Fabric has the potential of making their lives much easier. Just as Fabric can help eliminate the complexity of integration, it can also help reduce the complexity of governance.

^[1] Yes, we have Dave to thank and/or blame for this post.

^[2]This massive pearl of wisdom is from The Systems Bible by John Gall. I first encountered it in the early 90s in the introduction to an OOP textbook, and have been inspired by it ever since. This quote should be familiar to anyone who has ever heard me talk about systems and/or data culture.

Where does Power BI end and Microsoft Fabric begin?

On May 28, 2023 By Matthew RocheIn Azure, Fabric, Power BI2 Comments

Over the holiday weekend I joined Adam Saxton for a Fabric-focused Guy in a Cube live stream. It was a ton of fun, as these streams always are, and we ended up going for 90 minutes instead of the scheduled 60^[1].

Come for the hard-earned wisdom. Stay for the ridiculous facial expressions.

During the stream there were a few questions (including this one) where the answer involved understanding where Power BI ends and Microsoft Fabric begins. I suspect that this will be a common source of confusion in these early days of Fabric, and I hope this post will help clarify things.

Let’s begin at the beginning, with Power BI. When you think about Power BI, you’re probably thinking about something like this: Power BI as a SaaS cloud service for business intelligence.

The reality has always been a little more nuanced than this. Under the hood, Power BI has always included two main components: BI artifacts that operate on a general-purpose data-centric SaaS foundation.

Power BI includes artifacts like reports, datasets, dataflows, and more. Each artifact includes a set of user experiences and the underlying capabilities required to make those experiences work – things like the Analysis Services Tabular engine for datasets.

Power BI also includes things like workspaces, authentication and authorization, tools for content sharing, discovery, and management, administration and governance, and more. These foundational capabilities apply to every BI artifact.

When Power BI added support for dataflows, paginated reports, or goals, they worked just like you expected them to work based on your past experiences with datasets and reports. This familiarity was a function of that shared SaaS foundation, but for most people there was never a reason to think about Power BI as a service foundation with an increasing number of workloads running on that foundation.

With the introduction of Microsoft Fabric the distinction between the workloads and the service foundation becomes more apparent, because there are more workloads for more practitioner personas – and because the foundation includes OneLake^[2], a shared capability that is used by all workloads, but isn’t fully abstracted into the service foundation.

With Fabric, the collection of artifacts and experiences running on top of the service foundation has expanded significantly, but those new experiences will be familiar to Power BI users because they run on the same foundation that Power BI experiences have been running on for years.

As you’re exploring Fabric you may find yourself asking questions like “will X feature from Power BI work for this new Fabric thing?” The most likely answer is if the feature is shared across multiple Power BI artifacts and experiences, it will work for new Fabric artifacts and experiences as well. While Fabric is in preview there will be more exceptions to this rule^[3], but as Fabric moves to general availability these exceptions will be fewer.

With Fabric, the BI experiences and capabilities you’ve used and loved in Power BI will remain, and will continue to improve. And because all Fabric workloads run on the SaaS foundation that has supported Power BI for years, as that foundation grows and improves each workload will benefit from those improvements.

I’ll close with a gif. I’m generally not a big fan of gifs, but I think this one will illustrate and reinforce the story I’m trying to tell. Enjoy!

^[1] Despite this bonus time we ended up leaving tons of questions unanswered. I think there might be enough interest in Fabric to keep the cube guys busy for a while.

^[2]OneLake is a very big deal in Fabric, so if you haven’t already read my Introducing Microsoft Fabric and Microsoft Fabric and OneLake posts, you might want to check them out for additional information and context.

^[3]If you watched the question and answer from the live stream, you’ll see an example of this.

Managing Power BI tenant settings just got easier in Microsoft Fabric

On May 27, 2023May 28, 2023 By Matthew RocheIn Data Culture, Data Governance, Fabric, Power BILeave a comment

If you’ve read the Power BI adoption roadmap or attended any of the full-day training sessions I’ve been doing with MVP Melissa Coates^[1], you know how important it is to manage settings in your Power BI tenant, both for governance and for user enablement.

This week, Microsoft made this job easier with the introduction of a new GetTenantSettings API.

DALL-E prompt “power bi tenant settings administrator” because I couldn’t think of a better image to use

Until now, there hasn’t been a way to programmatically monitor tenant settings. Administrators needed to manually review and document settings to produce user documentation or complete audits. Now the GetTenantSettings API enables administrators to get a JSON response with all tenant settings and their values. With this information you can more easily and reliably share visibility into tenant settings for all of the processes where you need them.

If you’re a visual learner, check out this excellent video from Robert Hawker at Meloro Analytics that walks through using and understanding the API.

That’s it. That’s the post. I almost missed this important announcement with all of the other news this week – and I wanted to make sure you didn’t miss it too.

^[1] If you haven’t attended one of our past events, we’re both going to be in Dublin in less than two weeks, and I will be in Copenhagen in September. Given the way our schedules are looking, we don’t expect to have any more in-person appearances before the end of the year. If you’ve been waiting for an event closer to you, you’ll probably be waiting until 2024 or later.

Microsoft Fabric and OneLake: Data governance and enterprise adoption

On May 25, 2023 By Matthew RocheIn Data Culture, Data Governance, Fabric, Power BI2 Comments

The data internet this week is awash with news and information about Microsoft Fabric. My Introducing Microsoft Fabric post on Tuesday got just under ten thousand views in the first 24 hours, which I believe is a record for this blog.

Even more exciting than the numbers are the comments. Bike4thewin replied with this excellent comment and request:

I would love to hear your thought on how to adopt this on Enterprise level and what could be the best practices to govern the content that goes into OneLake. In real life, I’m not sure you want everyone in the organisation to be able to do all of this without compromising Data Governance and Data Quality.

There’s a lot to unpack here, so please understand that this post isn’t a comprehensive answer to all of these topics – it’s just my thoughts as requested.

In the context of enterprise adoption, all of the guidance in the Power BI adoption roadmap and my video series on building a data culture applies to Fabric and OneLake. This guidance has always been general best practices presented through the lens of Power BI, and most of it is equally applicable to the adoption of other self-service data tools. Start there, knowing that although some of the details will be different, this guidance is about the big picture more than it is about the details.

In the context of governance, let’s look at the Power BI adoption roadmap again, this time focusing on the governance article. To paraphrase this article^[1], the goal of successful governance is not to prevent people from working with data. The goal should be to make it as easy as possible for people to work with data while aligning that work with the goals and culture of the organization.

Since I don’t know anything about the goals or culture that inform Bike4thewin’s question, I can’t respond to them directly.. but reading between the lines I think I see an “old school” perspective on data governance rearing its head. I think that part of this question is really “how do I keep specific users from working with specific data, beyond using security controls on the data sources?”

The short answer is you probably shouldn’t, even if you could. Although saying “no” used to work sometimes, no matter what your technology stack is, saying “yes, and” is almost always the better approach. This post on data governance and self-service BI^[2] provides the longer answer.

As you’re changing the focus of your governance efforts to be more about enabling the proper use of data, Fabric and OneLake can help.

Data in OneLake can be audited and monitored using the same tools and techniques you use today for other items in your Power BI tenant. This is a key capability of Fabric as a SaaS data platform – the data in Fabric can be more reliably understood than data in general, because of the SaaS foundation.

The more you think about the “OneDrive for data” tagline for OneLake, the more it makes sense. Before OneDrive^[3], people would store their documents anywhere and everywhere. Important files would be stored on users’ hard drives, or on any number of file servers that proliferated wildly. Discovering a given document was typically a combination of tribal knowledge and luck, and there were no reliable mechanisms to manage or govern the silos and the sprawl. Today, organizations that have adopted OneDrive have largely eliminated this problem – documents get saved in OneDrive, where they can be centrally managed, governed, and secured.

To make things even more exciting, the user experience is greatly improved. People can choose to save their documents in other locations, but by default every Office application saves to OneDrive by default, and documents in OneDrive can be easily discovered, accessed, and shared by the people who need to work with them, and easily monitored and governed by the organization. People still create and use the documents they need, and there are still consistent security controls in place, but the use of a central managed SaaS service makes things better.

Using OneLake has the potential to deliver the same type of benefits for data that OneDrive delivers for documents. I believe that when we’re thinking about what users do with OneLake we shouldn’t be asking “what additional risk is involved by letting users do the things they’re already doing, but in a new tool?” Instead, we should ask “how we enable users to do the things they’re already doing using a platform that provides greater visibility to administrators?”

In addition to providing administrator capabilities for auditing and monitoring, OneLake also includes capabilities to data professionals who need to discover and understand data. The Power BI data hub^[4] has been renamed the OneLake data hub in Fabric, and allows users to discover data in the lake for which they already have permissions, or which the owners have marked as discoverable.

The combination of OneLake and the OneLake data hub provide compelling benefits for data governance: it’s easier for users to discover and use trusted data without creating duplicates, and it’s easier for administrators to understand who is doing what with what data.

I’ll close with two quick additional points:

Right before we announced Fabric, the Power BI team announced the preview of new admin monitoring capabilities for tenant administrators. I haven’t had the chance to explore these new capabilities, but they’re designed to make the administrative oversight easier than ever.
I haven’t mentioned data quality, even though it’s part of the comment to which this post is responding. Data quality is a big and complicated topic, and I don’t think I can do it justice in a timely manner… so I’m going to take a pass on this one for now.

Thanks so much for the awesome comments and questions!

^[1] And any number of posts (1 | 2 | 3 | 4 | 5 | 6 | 7 | …) on this site as well.

^[2]The linked post is from exactly two years ago, as I write this new post. What are the odds?

^[3]In this context I’m thinking specifically about OneDrive for Business, not the consumer OneDrive service.

^[4]The data hub was originally released in preview in late 2020, and has been improving since then. It’s one of the hidden gems in Power BI, and is a powerful tool for data discovery… but I guess since I haven’t blogged about it before now, I guess I can’t complain too loudly when people don’t know it exists.

Fabric CAT sessions at Data Ceili

On May 24, 2023May 28, 2023 By Matthew RocheIn Data Culture, Fabric, Power BILeave a comment

On Friday June 9th, Data Ceili – Ireland’s biggest Microsoft data platform event – returns to Trinity College in Dublin!

Update 28 May 2023: Adding one more CAT session to the list, and updating session times as the schedule has changed slightly.

You already know that I’ll be there with MVP Melissa Coates on June 8th to present a full-day pre-conference training day session on Power BI adoption best practices^[1]. Hopefully you’re already registered, and if not you can register today.

Today I can announce that there will be three Microsoft Fabric sessions during the main Data Ceili event on Friday. All three will be presented by members of the Fabric CAT team at Microsoft, and each will be based on deep engagement with the product team and private preview customers.

At 10:05 I’ll be presenting Introducing Microsoft Fabric. At 11:30 Luke Moloney will present Microsoft Fabric – What it means for data engineers. At 14:40 Kasper de Jonge will be presenting Microsoft Fabric, Lakehouses and Power BI: A guide for BI developers.

The three sessions should complement each other well. I’ll be covering the basics of the topics Luke and Kasper will cover in more depth as part of a more comprehensive overview, and Kasper and Luke will recap the big-picture intro before getting into the details of their more focused technical sessions.

The full details are available on the conference schedule. This looks like it’s going to be an exciting event, and I hope to see you there!

At this point, I suspect someone might be saying “wait a minute – did you say Fabric CAT team?”

Why yes, yes I did.

As you know, I’ve been part of the Power BI CAT team for the last five years or so, and I’m thriving on that team. One of the reasons I love this team so much is how it periodically reinvents itself to remain aligned with the evolving needs of the customers and product teams we support. Sometimes these changes are smaller, sometimes they’re bigger, and this time the change was big enough we needed to change the team name.

The not unlike how Microsoft Fabric represents the evolution of Power BI and Synapse, Fabric CAT represents the evolution of the Power BI CAT and Synapse CSE^[2] teams. We’re now a single team that’s better together, and I have one more reason to be excited about the future.

I know I can look forward to seeing you in Dublin, so I guess that should be two more reasons to be excited.

^[1] Yes, the discussion during the pre-conference will include Fabric.

^[2]Customer Success Engineering.

Introducing Microsoft Fabric

On May 23, 2023 By Matthew RocheIn Azure, Fabric, Power BI18 Comments

This week at Microsoft Build, we announced the future.

With an introduction like that, I should probably remind everyone that this is my personal blog, my personal perspective, and my personal opinions. Although I am a Microsoft employee, I am not speaking for or otherwise representing my employer with this post or anything else on this blog.

With that disclaimer out of the way, let’s get back to the future. Let’s get back to Microsoft Fabric.

According to the official documentation, “Microsoft Fabric is an all-in-one analytics solution for enterprises that covers everything from data movement to data science, real-time analytics, and business intelligence.” Fabric is implemented as a SaaS service for all sorts of data, analytics, and BI capabilities, including:

I’ve been working on Fabric for around 18 months^[1], and I could not be more excited to finally share it with the world. I don’t own any of the features coming in Fabric, but my team and I have been running an NDA private preview program with thousands of users from hundreds of customer organizations around the world building solutions using Fabric, and providing feedback to the product team.

This introductory blog post won’t attempt to be super technical or comprehensive. Instead, I’m going to share the information I’ve shared most frequently and consistently during the Fabric private preview – the information and context that will help you get started, and help put that more technical information into context.

For folks who are already familiar with Power BI^[2], Fabric is going to feel familiar from day one. This is because the SaaS foundation on which Fabric is built is the Power BI service you already use every day.

The foundation is evolving and improving, and there are new capabilities in lots of places, but the foundation of Fabric is the foundation of Power BI. This means that from day one you already know how to use it:

Workspaces – Fabric workspaces behave like Power BI workspaces, but with more item types available.
Navigation – If you know how to move around the Power BI portal you know how to move around the Fabric portal, because it works the same way.
Collaboration and content management – You can collaborate and share with Fabric items and workspaces just like you do with Power BI.
Capacities – New Fabric workloads use the capacity-based compute model used by Power BI Premium. If you don’t already have a capacity, you can start a free trial.
Administration – Fabric administration works like Power BI administration, and the Fabric admin portal is the evolution of the Power BI admin portal. To enable the Fabric preview in your Power BI tenant or for a specific capacity, you can use the admin portal.
Much, much more – I won’t try to list everything here, because there’s already so much documentation available.

At this point you probably get the idea. If you’re familiar with Power BI, you’re going to have an easy time getting used to Fabric. Power BI will continue to evolve and grow, and there are a lot of exciting improvements coming to Power BI in Fabric^[3] even without taking the new capabilities into account.

But what about those new capabilities? What about all the new data integration, data science, data engineering, data warehousing, and real-time analytics capabilities? How familiar will they be?

That’s a slightly more complicated question. In a lot of ways these new Fabric workloads are the evolution of existing Azure data services, including Azure Synapse, Azure Data Factory, and Azure Data Explorer. These established PaaS services have been updated and enhanced to run on the Fabric shared SaaS foundation, and their user experiences have been integrated into the Fabric portal.

If you’re already familiar with Azure Synapse, Azure Data Factory, and/or Azure Data Explorer, the new capabilities in Fabric will probably be familiar too. You already know how to work with pipelines and notebooks, and you already know how to write SQL and KQL queries – in Fabric you’ll just be doing these familiar things in a new context.

There are a few key Fabric concepts that I’ve seen more new-to-Power BI preview customers as questions about. If you or your colleagues are more Azure-savvy than Power-savvy, you’ll probably want to pay attention to:

Capacities – Fabric uses capacities for compute across all experiences^[4], which provides a consistent billing and consumption model, but which will necessitate a change in thinking for folks who are used to other service-specific approaches to billing and consumption.
Workspaces – Other services don’t have the same concept of a workspace as Power BI and Fabric do… but some of them have different concepts with the same name. Since workspaces are a crucial tool for content creation, organization, and security, understanding them and how they work will be important for success with Fabric.
A “managed” SaaS data service – In most data services, the “catalog” of items and their relationships is expressed through the metadata of a given instance. This means that capabilities like discovery, lineage, impact analysis are either absent, limited in scope, or only available through integration with an external data catalog or similar service. Fabric, like Power BI, maintains an internal data catalog for all items in the tenant, and their relationships to each other. This information is exposed through APIs and integrated into experiences like the workspace lineage view and the data hub, making it easier to discover, understand, and use data.

In addition to things in Fabric that will be familiar to people with Power BI experience and things in Fabric that will be familiar to people with Azure data experience, there’s one huge part of Fabric that is going to be new to everyone: OneLake.

OneLake is a SaaS data lake that is a key component of the Fabric SaaS foundation^[5]. Every Fabric tenant includes a single OneLake instance, and all Fabric experiences work natively with data in the lake.

OneLake is open – OneLake is built on ADLS Gen2. You can store any type of file, and use the same APIs you use when connecting to ADLS Gen2. Storing data in OneLake doesn’t mean it’s locked into Fabric – it means it can be used where and how you need it to be used.
Delta by default – Fabric experiences store their data in OneLake in parquet delta files. Delta is an open source, compressed columnar format that supports ACID transactions, and is supported by a wide range of tools.
Store once, use everywhere – Because there’s one OneLake, data can be ingested and stored once and used where it’s needed. You can have a single set of delta files that are exposed as a lakehouse and manipulated using notebooks, while at the same time are exposed as a warehouse and manipulated using SQL, and exposed as a Power BI tabular dataset in DirectLake mode. This decoupling of storage and compute is enabled by OneLake, and I expect it to be one of the most significantly game-changing aspects of Fabric as a whole.
OneLake is integrated – Being open makes it easy for you to store your data in OneLake while using it with whatever tools and compute engines you choose. OneLake shortcuts allow you to keep your data where you have it today while logically exposing it as if it were stored in OneLake.

OneLake takes the familiar concept of a data lake, and puts it where no one sems to expect it: at the center of work, where it makes sense, deeply integrated into the tools and experiences used by everyone contributing to a project or product.

With all of these new and familiar capabilities coming together into a single SaaS platform, the next thing that Fabric delivers is a comprehensive set of user experiences.

Modern data projects often involve a wide range of practitioners – data scientists, data engineers, data developers, BI developers, report authors, and more. Before Fabric, each practitioner persona would typically work in their own set of tools and experiences, each of which had its own strengths and weaknesses and capabilities. When taken together, this means that most projects involve significant integration effort to make the output of one tool work with the next tools in the value chain – and often there are tradeoffs made to accommodate the mismatch between tools.

With Fabric, each task and persona has a purpose-built set of experiences that all work natively with the same data in OneLake. The result is that data practitioners can focus on delivering value through their data work.. not on building integrations so their tools will work together. Teams can set up workspaces that contain the data and items they need – lakehouses, warehouses, notebooks, spark jobs, pipelines, dataflows, dataset, reports, and more. Data in one workspace can be used in other workspaces as needed, and because of OneLake it can be stored once and used multiple times without duplication.

During the Fabric private preview, the chief data officer of a well-known global organization^[6] said something to the effect of:

With Fabric I can finally be a Chief Data Officer instead of being a Chief Integration Officer.

And this is why I believe Fabric represents the future of data.

Think back 10-12 years when the first generation of PaaS data services were becoming available. Many data practitioners looked at them and dismissed them as solutions to imaginary problems – why would we ever need a cloud service when we had these beautiful database servers in our own data centers, with IO subsystems we’ve designed to our own specs and fine-tuned to the nth degree^[7]? It took time for people to realize the value and advantage of the cloud, but today there are entire classes of problems that simply don’t exist anymore because of the cloud.

I believe that the integrated, open, flexible, SaaS nature of Fabric means that we’re at an inflection point as significant for data as the advent of the cloud. Fabric will eliminate entire classes of problems that we take for granted today – in a few years we will take this new platform and this new paradigm for granted, and wonder how we ever thought those problems were an acceptable part of our professional lives.

Welcome to Fabric. Welcome to the future of data.

Ok, that’s my post. Where should you go from here? In addition to all of the links above, you should definitely check out the official blog post for the official big picture. You should also join us Wednesday and Thursday for a “simulive” virtual event as we go deeper into many of the key capabilities now available in Fabric.

I’ll see you there.

^[1]Old man voice: Back when I was your age we called Fabric “Trident” and we weren’t allowed to talk about it in public because if the Kaiser heard about it our boys fighting in France would be at risk! Let me tell you about the time I…

^[2]If you’re reading this post on this blog, I suspect this includes you. I’d love to know if you agree with my “feels familiar from day one” assertion.

^[3]I’m working under the assumption that the interwebs will be flooded today with blogs and announcements and guys in cubes, so I’ll leave it up to you to track down what’s exciting for you.

^[4]Yes, you need a capacity for all new Fabric experiences. Power BI licensing is not changing, but to work with the new Fabric capabilities you need a capacity to run them on. Fabric capacities are available in smaller SKUs than Power BI capacities.

^[5]You probably noticed it in the diagram image above, sitting there in the middle all integrated and important.

^[6]You know this company, but since this is my personal blog I’m probably not going to get their permission to name them. Also, as I write this blog post I can’t find the verbatim customer quote, so you’ll need to rely on my imperfect memory for this one.

^[7]As I type this in 2023, I can’t remember the last time I worked with an on-prem production database. It was probably 2011 or 2012. It feels like something from another age, another life.

Getting Medieval on Your Career

On May 19, 2023May 24, 2023 By Matthew RocheIn Career, Communication, SwordsLeave a comment

In longsword fencing there exists the concept of the bind.^[1]

Two fencers in the bind, swords crossed.

The bind is a moment of risk and of opportunity.

The bind is a moment of vulnerability and of truth.

The bind is when your sword and your opponent’s sword are in direct physical contact, blade to blade.

This is not the same picture. This is not the same bind.

Before the bind you are in a position of uncertainty.

There are some things that you cannot know. You may believe them, and you may be right, but you cannot know them. A skilled opponent can deceive through their eyes, their hands, the motion of their blade…

…but in the bind this deception falls away. In the bind you know your opponent’s location, their momentum, their pressure, their strength, their weakness.

A skilled swordsperson can read all of this and more in an instant, because of what your sword is telling their sword.

Entering into the bind can be scary. What if you’re not ready? What if the know what you’re going to do, and are prepared and waiting? What if…. what if a thousand things.

This fear is the product of uncertainty. Before you’re in the bind, you can’t be certain. You can only feint and position yourself and hope and prepare.

Evaluate, act, change the bind to your advantage.

But once you’re engaged, that uncertainty is gone. You can meet strength with weakness and fluidity. You can meet weakness with strength and aggression. You can exploit the opportunity that the moment represents, in the moment, before it passes.

Because you know.

You know, and because you know, you can act.

Use that advantage to make additional progress towards your goals.

And then you act, and act, and act again, because this is a dynamic constantly-changing dance of steel, and the bind might last only for the briefest heartbeat before the opportunity is lost.

And this is where the work part of this work-adjacent post comes in. This isn’t really about longsword fencing. This is about the risk and opportunity that comes from being in direct immediate contact with other people, other teams, or other organizations.

Most interesting problems are people problems. The technology will work itself out, but who the hell knows what human beings are going to do?

What happens when I send that broad email or meeting invite?

What happens when I share my work in progress?

Will it be this 👇?

Preparation can help ensure that you avoid unfortunate consequences of entering the bind.

There is a time for training, for planning and preparation.

As that time comes to an end, and the time for action approaches, it is natural to be nervous. It’s human to be afraid.

But the time to act always arrives, whether or not we feel ready.

When you send that email, schedule that meeting, have that difficult conversation…

When you release the preview and let the first users work with your hopefully-ready-enough product…

When you share your work in progress for input…

…then you know.

Then you have certainty.

Because you are now in the bind.

Just like when fighting with a longsword, there comes the moment where you no longer need to worry about what they’re going to do, because they’re doing it.

You no longer need to wonder how you will react because you are already acting.

You receive feedback, you respond.

You receive agreement or praise, you proceed.

You receive criticism, you withdraw, or you remise.

But either way, once you are in the bind you are acting, and acting, and acting. Acting with certainty.

Most importantly, you’re acting with a certainty that was impossible before you entered the bind.

Blade to blade, person to person, team to team, the direct contact and engagement tells you things that you otherwise could not possibly know.

That step away from uncertainty and the illusion of safety to certainty and risk is never simple or easy.

When you ask “what’s the worst that could happen?” you might respond with some truly awful outcomes.

Sometimes the snoot gets booped in the bind.

This is why you train.

This is why you practice.

This is why you study.

And this is why you do your best to operate in an environment with a safety net. An environment with a culture of shared goals and where the right kinds of failure are rewarded, not punished.

Whether you’re training with swords or training for the business world, you’ll practice with and learn from people who have your best wishes in mind. You’ll take on increasingly difficult challenges, but you’ll do it while working with coaches and mentors and teammates long before you compete for real stakes.

And because you’ve prepared and practiced and trained and studies, you’re confident. You may not know what will happen, or that you will achieve the outcomes you desire, but you are confident that when you enter into the bind you will be able to respond and act.

And act…

Ok… I didn’t really know where this was going to end when I started, and I’m not sure if I’ve gotten where I wanted to go with this analogy. I guess I’ll stop connecting dots that probably only make sense to me, and speak more clearly.

For much of the past year, my work life has been full of these moments. It’s been filled with people^[2] who are uncertain, hesitant to move forward, not knowing what will happen if they take the actions they know they need to take. Also people who are moving forward rashly, taking risks that might pay off against an unskilled opponent, but which could lead to dire consequences if they’ve misjudged the encounter.

These days I’m in a position where people often come to me asking for advice and guidance. I’ve been hearing “but what if” more lately than usual in these conversations.

I’ve asked “but what if” more than once myself.

In most cases, my advice has been to enter the bind. “You can’t know what will happen until you take that step – so take it and see where you are, and then figure out what to do next.” “You cannot know what THEY will do until they do it, and they can’t do it until you act.”

Another part of my response has been to remind people that they are not acting alone. They’re taking some significant action for which they are responsible, but they’re doing it to help achieve some larger shared goal.

Because of this, they have a safety net.

When in doubt, act. Strike while the iron is hot.

Spend your time proactively preparing, training, practicing, learning… so that when the moment comes you can act and choose the best possible course of action.

Don’t act rashly. Don’t rush in blindly. But when in doubt, act. If you don’t act, then someone else will act and the moment of opportunity will have passed.

I’ll close with an apology to all the longsword practitioners out there who might take offense with my questionable definition of the bind. I had to be flexible to make the analogy work. I acted. Fight me.

The punta falsa. There’s nothing quite like it.

Fiore de’i Liberi wrote some advice that applies to more than just violence in the preface to the manuscript from which these pictures were taken.

Be audacious in violence and young at heart. Have no fear in your mind; only then can you perform.

Words to live by. ⚔️

^[1] This is going to be a work-adjacent post more than a sword post. My week has been full of examples of these concepts at play, so I decided to resurrect a long-deleted Twitter thread and share these thoughts with the world once more. Buckle up.

^[2]Some of these people have been me.

The parable of Clark Kent and the performance review

On May 13, 2023 By Matthew RocheIn Career, Diversity, Mental HealthLeave a comment

Few people know this, but before he found a job working for the Justice League, Clark Kent worked for years as a kryptonite delivery guy^[1].

DALL-E prompt: "superman, sick sad and depressed, carrying a glowing green cardboard box, pen and ink line art"

Try as he might, Clark never seemed to figure out this job. His coworkers made it look so easy, but Clark struggled every day. Some of his colleagues supported and helped him, but he knew others were frustrated and felt that he was letting them down.

Clark dreaded going to work each morning, and at the end of the day he felt sick, exhausted, and disheartened. He was determined to try harder and not give up, but when an interesting opportunity presented itself, he applied for a new position. Although it took him a little while to adapt to his new team, he soon found that in the right environment he could fly. Literally. The rest of the story you probably already know.

Even though this story is about Superman, it feels like it could be about me. Maybe it feels eerily familiar to you too… and maybe you feel like you still have a big box of kryptonite in your arms.

If you’ve seen my “Unplanned Career” presentation you’ve heard a version of this story already, but I spent 7+ years of my career at Microsoft delivering my own personal kryptonite. I tried extra hard and occasionally succeeded, but compared to my peers and my leaders’ expectations, I simply didn’t measure up. It wasn’t until I found my current role and team that I learned that I could fly.

If you’re in a situation, in a role, or on a team where the things you need to do are harder for you than they are for everyone else, or where the thought of going to work makes you ill, perhaps it’s time to look for your next role. I’m not talking about giving up – I’m talking about moving up.

Instead of falling prey to the sunk cost fallacy, why not step back and ask yourself these questions?

What am I good at – especially where am I strong where others are weak?
What gives me joy and energy when I do it?
Who has the problems that I am uniquely qualified to solve?

I’m not convinced I’ve articulated these questions as well as I should, but I’m going to keep pushing forward. Ideally your honest answers to these questions will start you thinking about the unique value that you can contribute, and that in turn can help you start thinking about where that contribution will be uniquely valued.

I’ve been thinking about this post for months, but the pieces didn’t feel ready to fall into place until today. Perhaps that’s because today I completed my end-of-year Connect^[3], and I realized what an awesome year I’ve had. I kicked all the butt and took all the names, and then I forgot half the names when there was more butt that needed kicking. It was a very good year, in ways I could never have imagined before I found my amazing team.

It’s not only that I’m doing incredible, high-value and highly-valued work – it’s that it’s almost effortless.

Please don’t get me wrong. I work very hard, and I struggle every day. I’m pushing myself to learn and grow, and sometimes I fail. When I do fail, I think back to how I felt when I was delivering kryptonite every day. I’m doing things I’m good at, and which give me energy and joy. I’m doing them for leaders who recognize, respect, and value what I do. I may be flying against the wind, but I’m still flying.

If you’re not flying, maybe its time to ask yourself why not.

^[1]I’m not sure why I can’t find the comics where this story was originally presented, but I swear on Batman’s mom’s grave^[2] that the story is true.

^[2]Too soon?

^[3]The “Connect” is the self-appraisal part of Microsoft’s semi-annual performance review process. It’s designed to be a lighter-weight check-in between employee and manager, and an opportunity to evaluate progress and align on goals for the period ahead. The Connect that comes before the end of the fiscal year is a major input into the rewards process that determines things like promotions, raises, and bonuses. As you can imagine, completing my Connect is my least favorite task of the year, and it always seems to take me 10x as long as it takes everyone else, which feels very on brand for this blog post…

It’s going to be big – join the Power BI team at Build!

On May 6, 2023 By Matthew RocheIn Power BILeave a comment

My favorite part of flagship Microsoft conferences like Microsoft Build is that we get to share with the world some of the exciting things that we’ve been working on for months.

At this month’s Microsoft Build conference, the Power BI and Azure Synapse teams are going to unveil something special.^[1] If you don’t believe me, check out the pre-announcement post on the Power BI blog. The details are there, but I can’t keep myself from sharing the session lineup here:

Microsoft Build keynote: Analytics in the age of AI
Transform productivity with AI experiences for analytics
Eliminate data silos with the next-generation data lake
Modernize your data integration for petabyte-scale analytics
Unlock value from your data with a modern data warehouse
Use Spark to accelerate your lakehouse architecture
Secure, govern, and manage your data at scale
Go from models to outcomes with end-to-end data science workflows
Empower every BI professional to do more with data
Sense, analyze, and generate insights with real-time analytics
Accelerate your data potential with Microsoft

The speakers are a who’s who of product leaders, and the whole thing is being hosted by your favorite Guys in Cubes, Adam and Patrick.

Microsoft Build kicks off on keynotes on Tuesday May 23, and continues on the 24th. If you can’t join us in Seattle, you can register online to attend virtually.

^[1] Seriously.

Data Moshpit

On April 12, 2023 By Matthew RocheIn Azure, Community, Heavy Metal, Power BI, PresentationsLeave a comment

You read that correctly. Data moshpit.

This September the greatest thing in the history of great things happening will happen. On Saturday September 16, in a metal club in Berlin, data platform MVPs Ben Kettner and Frank Geisler are JOINing^[1] the two best things in the world: data and heavy metal.

Data Moshpit is a one-day community event with a heavy metal theme. The sessions will be metal. The speakers will be metal. The atmosphere will be metal. There will be beer and food and if my experience at metal shows in Germany have taught me anything, lots of brothers of metal and sisters of steal wearing leather and denim and the coolest jean jacket vests with giant Manowar back patches.

The Data Moshpit call for speakers is open now, and closes on July 7th. You can submit metal-themed sessions of your own, or just check out the exciting sessions already submitted.

If you’ve got a heart of steel and data for blood, this is the one event of 2023 that you cannot afford to miss. And if you’re not into metal^[2], you should come anyway. It will be a great opportunity to connect with the community and learn something new. I hope to see you there!

^[1] Yes, I made this joke. Don’t be CROSS.

^[2]You can still be my friend, don’t worry.

BI Polar

Author: Matthew Roche