Detailed logs for Data-reader (http)

Previous Member

Are detailed logs available for Data readers? For example, I have a data reader that extracts from an HTTPS endpoint (hosted on AWS). This keeps failing randomly (from what I have observed), what are the possibilities of maybe checking for the connection status or response header and body ??

 

So the above data reader executes in the following manner...

 

1. Extract data from AWS end-point A (parameter 1)
2. Wait for 1 min
3. Extract data from AWS end-point A (parameter 2)
4. Wait for 1 min
5. Extract data from AWS end-point A (parameter 3)

 

So in the above procedure, all 3 steps (1,3,5) extract data from the same end-point (with different parameters). Some days step 1 will fail and other days it might be 3 or 5 and most days no issues.

 

in addition to detailed logs, is there a feature to send alerts if a task fails?

 

Regards

     Chris

Helmut Heimann

Hi Chris Jansz!

As of now there is no possibility to fire an alert if a task fails directly--you'd have to build your own "assistance protocol" writing defined values to status cubes for every step/stage of your DataReader tasks and evaluating those values during the data load process.

You can find more information on logs here: BOARD LOGs in detail 

 

Kind Regards,

Helmut

Previous Member

Thanks for the info.