7 thoughts on “Dataflows, CDM folders and the Common Data Model

  1. Pingback: Power BIte: Creating dataflows by attaching external CDM folders – BI Polar

  2. Rick

    Hello Matthew.
    Thank you for the great article.
    I have one question that looks like important for me.
    You mention about the “collection of predefined schemas includes entities, attributes, semantic metadata, and relationships”. Everything is clear to me except relationships. What role do the relationships play in the CDM? It is not visible as entities and attributes… Are those relationships standard and static? As I understand they connect all entities in the internal CDM datawarehouse? If so what happens if some of my custom datasource tables don’t fit any of standard CDM entities, in that case as I understand this table is separated from the CDM datawerehouse since it doesn’t have any relationships ?
    Thank you in advance!

    Like

    1. Short answer: I think the key here is “standardized, extensible data schemas.” The relationships are part of the “reference metadata” and can be used or disregarded as needed. Since this is metadata only, the data store (CDS, ADLSg2, etc.) will have its own representation to implement the metadata, including the relationship.

      Longer answer: I think that Point #4 (“You don’t need to use any standard entities”) is the point you want to focus on, not Point #3. The use of any of these reference entities is 100% optional.

      Like

      1. Rick

        Then what could be the benefits of using standard entities at all? Are there any cases those standard entities are useful?
        I know that “These folders facilitate metadata discovery and interoperability between data producers and data consumers.”, but this a mechanism only, what are the outputs for developers and users?

        Like

  3. Pingback: New resource: Generating CDM folders from Azure Databricks – BI Polar

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s