Sending data between data models.

Hi Board,

We have two different data models and we need to sedn data from the one data model to the other and vice versa.

Currently what we have tried is the following:

  1. Extract the data from data model A, call a procedure in data model B that would import the extract through Azure using a data reader and paste the data into a cube.
  2. Use API queries and REST API aclls to pull data between the models.
  3. We looked at the pipeline but this would require us to use exstra connectors.

The problem with option one and two is that we have to create a file first.

Are there any other ways to send data between models without having to create an extract file for a data reader to pick up and push into a cube?

Kind Regards

Marius Lubbe

Accepted Answers

  • Yanis Bouayad
    Yanis Bouayad Employee
    Second Anniversary Level 300: Expanding Board in Your Organization Level 100: Foundations of Building in Board Level 200: Building A Planning Solution in Board
    Answer ✓

    Hello Marius,

    I hope you are doing well !

    The idea I got that is not using a file is the procedure step "BULK Insert to SQL table" .

    This step allows you to push your data to an SQL table. You can import it back from the sql on the other datamodel using data reader. It's not the most efficient but it allows you to go through a more secure option than flat files and you can keep the data available for your other model for future imports.

    Let me know if this answer help.

    I wish you a nice day !

    Kind regards,

    Yanis BOUAYAD

  • Leone Scaburri
    Leone Scaburri Employee
    Fourth Anniversary 100 Comments 5 Answers 25 Likes
    Answer ✓

    Hi @Marius Lubbe,

    take a look at our best practice article about sinchronization between different data models.

    It include different aspects such:

    • Adding members to entities.
    • Adjusting/managing changes in relationship(s).
    • Feeding cubes.

Answers

  • Marius Lubbe
    Marius Lubbe Active Partner
    Third Anniversary 10 Comments Board Developer Level 300: Expanding Board in Your Organization

    Hi Yanis,

    Thank you for the quick response.

    Sadly our client's database is maintained by a third party company that cannot allow us to insert data back in the database using the bulk insert to SQL table.

    Does this mean we only have the four options to send data between data models?

    1. Extract the data from data model A, call a procedure in data model B that would import the extract through Azure using a data reader and paste the data into a cube.
    2. Use API queries and REST API aclls to pull data between the models.
    3. We looked at the pipeline but this would require us to use exstra connectors.
    4. Use Bulk insert to SQL table and extract the data using the pipeline into the second datamodel.

    Kind Regards Marius.

  • Marius Lubbe
    Marius Lubbe Active Partner
    Third Anniversary 10 Comments Board Developer Level 300: Expanding Board in Your Organization

    Hi @Leone Scaburri

    Thank you for the above information.
    We will take it into consideration.

    Kind Regards

    Marius Lubbe