Top Datadog Interview Questions (2024)

1. What is Datadog?

2. How does DataDog work?

3. How does Datadog store data?

4. How does Datadog collect data?

5. Can alerts from a single DataDog monitor be routed to different Slack channels?

6. How to read Flink latency tracking metric in Datadog?

7. Using Datadog, how to create different alerts for https://status.aws.amazon.com/ to keep track of the status of specific services?

Q: What is Datadog?
Ans:

Datadog is a monitoring and SaaS-based data analytics tool for IT and DevOps teams that can be used to assess performance metrics and event monitoring for infrastructure and cloud services. Servers, databases, and tools can all be monitored using the software.

Q: How does DataDog work?
Ans:

The Datadog Agent is a software application that runs on your servers. It collects host events and metrics and delivers them to Datadog, where you can evaluate monitoring and performance data. The Datadog Agent is open source, and the source code can be found on GitHub at DataDog/datadog-agent.

Q: How does Datadog store data?
Ans:

It's kept in a variety of different data stores, and then the query system pulls the data from those multiple data stores, brings it together, and feeds it back in a variety of ways, including APIs, dashboards, and monitors and alarms.

Q: How does Datadog collect data?
Ans:

Datadog collects logs from AWS Lambda. We can accomplish this with serverless monitoring. Datadog integrations and log gathering are intimately connected. To activate dedicated processors, parsing, and facets in Datadog, use an integration default configuration file.

Q: Can we send log to Datadog without Datadog agent?
Ans:

Yes, we can utilise most of the common open source log shippers, such as fluentd or HTTP API, to send server logs to Datadog without using the Datadog agent. However, there are significant advantages of using the Datadog agent to collect server logs.

Q: Can alerts from a single DataDog monitor be routed to different Slack channels?
Ans:

Yes, We could use a tag that is an exact string match on some part of the slack channel (the tag would have to be route:abc and not route:/abc).

Then you could use something like @slack-route.name-alerts, which automatically dereferences the tag and delivers it to the relevant group.

If we can't find a tag that fits any part of the slack handle, we can create a if else conditional.

{{#is_match "route.name" "/abc"}}
  @slack-abc
{{/is_match}}
{{#is_match "route.name" "/yyy"}}
  @slack-yyy
{{/is_match}}
{{#is_match "route.name" "/xxx"}}
  @slack-xxx
{{/is_match}}
{{^is_match "route.name" "/abc" "/yyy" "/xxx"}}
// Please ensure that this endpoint is set to forward to the 
// appropriate team's channel within this monitor.
  @slack-backup-alert-channel
{{/is_match}}

Can refer Datahog official site to Create Dynamic Alerts

Q: How to read Flink latency tracking metric in Datadog?
Ans:

We can access Flink metrics using rest api integration:

http://{job_manager_address}:8081/jobs/{job_id}/metrics

Output:

[
  {
    "id": "latency.source_id.2d28fff76g16644ad0856sdb767jbhsd6.operator_id.4hgdh786hgh5vf65hgfr54hghghs7687.operator_subtask_index.7.latency_min"
  },
  {
    "id": "latency.source_id.4sdg875gfd65gh767hghj76hgh43fd576.operator_id.423vvg76565hhj76767cxedse56567fd6.operator_subtask_index.14.latency_p75"
  },
  {
    "id": "latency.source_id.4sdg875gfd65gh767hghj76hgh43fd576.operator_id.btf6565ghgd76i9skoh7885dv438jhjh86.operator_subtask_index.12.latency_median"
  },
]

It indicates that the latency from source id 2d28fff76g1664... to operator id 4hgdh786hgh5v... with subtask index 7.

Q: Using Datadog, how to create different alerts for https://status.aws.amazon.com/ to keep track of the status of specific services?
Ans:

To receive notifications of new messages, we can use RSS feeds with a feed reader or an integration in a messaging application (e.g., Slack).