Questions tagged [datadog]
Datadog is a monitoring service for IT and DevOps.
datadog
1,111
questions
29
votes
4
answers
19k
views
Replace no data by zeros in datadog graphs
There does not seem to be a way to replace no data by zeros when using formulas in datadog.
I've tried fill zero but it doesn't seem to work
I would simply like my dd agent monitor to display 0 ...
- 2,608
22
votes
3
answers
39k
views
How to search Datadog logs by Attribute
Question about searching logs in Datadog.
Search works on regular strings in the CONTENT portion of the log. However, if JSON is passed to the CONTENT portion, the JSON elements are automatically ...
- 1,647
22
votes
1
answer
16k
views
query metrics on tag value with regex in datadog
I want to filter metrics on tag value with a regex. I can do it in Prometheus but I could not find an equivalent way in Datadog.
For example, to select the following metric whose status tag value ...
- 4,121
18
votes
2
answers
15k
views
DataDog Log Search empty string facet
On DataDog log search, I want to search for logs with empty string for a specific facet, e.g. logs with userId is empty. @userId:'' , @userId:"", -@userId:* non worked.
- 2,540
18
votes
2
answers
8k
views
Datadog export logs more than 5,000
I want to export more than 5000 logs in csv from datadog, is there any configuration I need to do in datadog so that I can download 10k,20k logs at a time.
I also checked on official web page logs ...
- 456
17
votes
1
answer
14k
views
What is the difference between the count and the gauge metric type in DataDog?
What is the difference between the count and the gauge metric types in DataDog? Or rather, when should I prefer one over the other? The definitions from their website don't help me much:
Count:
The ...
- 14.5k
16
votes
4
answers
10k
views
Does Datadog support graphs with 2 Y-axis with different scales? [closed]
Like this one:
[
If yes, how do I create one?
From all documentation I've read so far, it doesn't seem to support it. But I don't see anyone confirming that it's not supported anywhere.
- 16.1k
16
votes
4
answers
17k
views
How to setup Serilog with Azure Functions v4 correctly?
I want to use Serilog in an Azure Function v4 (.net 6) (the logs should be sent to Datadog). For this I have installed the following nuget packages:
<PackageReference Include="Serilog" ...
- 296
15
votes
3
answers
31k
views
Spring boot metrics + datadog
Does anyone know how to integrate Spring boot metrics with datadog?
Datadog is a cloud-scale monitoring service for IT.
It allows users to easily visualice their data using a lot of charts and ...
- 9,951
13
votes
1
answer
5k
views
How to calculate duration between logs in Datadog?
Splunk has transaction command which can produce duration between logs grouped by id:
2020-01-01 12:12 event=START id=1
2020-01-01 12:13 event=STOP id=1
as it is described on
Query for calculating ...
- 8,458
12
votes
1
answer
13k
views
Error: UPGRADE FAILED: failed to create resource: ConfigMap in version "v1" cannot be handled as a ConfigMap
Per this spec on github and these helm instructions I'm trying to upgrade our Helm installation of datadog using the following syntax:
helm upgrade datadog-monitoring --set datadog.confd."...
- 10.4k
12
votes
1
answer
3k
views
Datadog: Use a tag value in an alias
I have a timeseries graph in a time board that displays data for one metric that has multiple tags called "page". The graph has one line for each tag and I'm running functions on the values, so the ...
- 1,172
12
votes
1
answer
14k
views
How to log output from Airflow DAG for debugging?
I am writing a Airflow DAG and having some problems with a function. I am trying to debug by printing data to stdout and using the logging library.
My example DAG is:
from datetime import ...
- 27.6k
11
votes
1
answer
15k
views
How to get the number of different values of a metric's tag in Datadog
I have a metric which has a tag with lots of different values (the value is a file name). How can I create a query that determines the number of different values of that tag exist on a metric?
For ...
- 113
11
votes
0
answers
3k
views
Datadog: METRIC.as_rate() vs. per_second(METRIC)
I'm trying to figure out the difference between the in-application modifier as_rate() and the rollup function per_second().
I want a table with two columns: the left column shows the total number of ...
- 111
10
votes
4
answers
15k
views
How to stringify JSON using JQ
Using JQ I would like to take a complex JSON object that includes JSON embedded as strings and then turn it all into a valid string I can easily embed in other JSON objects.
For example, lets say I ...
- 5,826
10
votes
4
answers
7k
views
datadog agent not reachable from inside docker container
I installed dd-agent on Amazon linux ec2. If I run my python script directly on the host machine (I used the SDK named "dogstatsd-python"), all the metrics can be sent to datadog (I logged in to ...
- 191
10
votes
1
answer
1k
views
can Datadog be used to display the difference in time between two events or logs?
I am using Datadog's count API and if I have 2 events emitted with the same tag (like a UUID), I want to plot a distribution graph of the difference in time between these two events. (e.g. I have an ...
- 101
9
votes
1
answer
22k
views
Datadog Grok Parsing - extracting fields from nested JSON
Is it possible to extract json fields that are nested inside a log?
Sample I've been work on:
thread-191555 app.main - [cid: 2cacd6f9-546d-41ew-a7ce-d5d41b39eb8f, uid: e6ffc3b0-2f39-44f7-85b6-...
- 349
9
votes
2
answers
6k
views
How do I query DataDog for a phrase in the stack trace?
DataDog is so useless in its querying and its intuitiveness ... I'm looking for a custom exception in the stack trace. I found individual log entries in the last 18 hours that contain my exception ...
- 4,452
9
votes
3
answers
6k
views
Remove a metric from Datadog
I'd like to remove a custom metric that I've created with my Datadog account. Is there a way to do that ?
I've checked the docs, and did not find anything relevant for the metrics deletion.
Regards,
...
- 231
9
votes
1
answer
5k
views
Sending ddtrace from docker
I'm trying to learn how to use docker and am having some troubles. I'm using a docker-compose.yaml file for running a python script that connects to a mysql container and I'm trying to use ddtrace to ...
- 2,305
9
votes
3
answers
6k
views
How to count events in Datadog Screenboard
I don't understand the difference between events and metrics in DataDog. I'm trying to create a count indicator in my dashboard so I can now how many times some type of event has happened.
There ...
- 2,187
9
votes
1
answer
6k
views
Display count for a day using counter metrics in data dog
We have a counter metric in one our micro services which pushes data to DataDog. I want to display the total count for given time frame, and also the count per day (X axis would have the date and Y ...
- 5,421
8
votes
3
answers
10k
views
Restrict access to nginx server location to a specific Docker container with "allow" directive
Edit: Tarun's answer does exactly what I asked for. Eugen's answer is also a very good solution. I ended up accepting Tarun's answer as correct, but using Eugen's. If you have a similar issue and are ...
- 5,384
8
votes
2
answers
8k
views
Modify scale of Datadog metric
I have a time series presenting time values like this one:
I want to change the y-axis to represent hours instead of milliseconds, i.e. divide by 3600. Any idea how to do it?
- 5,066
8
votes
1
answer
7k
views
Can I export Datadog dashboards via Datadog REST API?
Is it possible to export or download Datadog dashboards via Datadog REST API?
Export and update of Datadog Monitors works fine. I need the same functionality for dashboards.
- 1,359
8
votes
1
answer
8k
views
How to post process JSON logs with Datadog?
Our applications log in JSON format. According to Datadog's documentation JSON logs are not processed by pipelines. How can I enrich the JSON logs with an additional field that is based on a different ...
- 39.9k
8
votes
1
answer
4k
views
Send log messages from datadog to slack channel
Is it possible to send log messages(content in the log message) in Datadog to one of the slack channel? I have tried using the monitors. But there it just provides an alert if log messages exceeds the ...
8
votes
0
answers
2k
views
How do I add a label for the y-axis in Datadog?
I have a chart for a custom metric like this one:
How can I add a label for the y-axis? I don't see any option in the dashboard settings. Exploring other metrics, I see they already have such label. ...
user4093955
8
votes
0
answers
3k
views
String interpolation with the name of metric in the Datadog query
There are a bunch of custom metrics that looks like:
metric.name.key1
metric.name.key2
...
There is a template variables dropdown (https://docs.datadoghq.com/dashboards/template_variables/) on the ...
- 3,179
8
votes
0
answers
3k
views
Unique tag count in a DataDog top list
I've a metric which has 2 tags (it has more but this is for simplicity), client and rule, and its value of course. With it I can see the total count of the values for each client, each rule and each ...
- 91
7
votes
4
answers
2k
views
How to determine the time Node.js spends to send an HTTP response body?
My current setup involves a Node.js web application using Express.js.
I am using DataDog's dd-tracer to measure the time Node.js spends for particular method invocations as part of my APM solution.
I ...
- 6,539
7
votes
1
answer
4k
views
Logging unhandled Golang panics
I have a logrus log handler in my Golang application. Logs are formatted with JSONFormatter and are submitted as a single line to Datadog, which aggregates them and displays them nicely. However, I ...
- 73
7
votes
2
answers
6k
views
When to use Datadog Distribution and Histogram
I cannot find any article that describes the advantages of using datadog histogram compared to datadog distribution for apps that run on multi instance. Would someone kindly help me on deciding the ...
- 73
7
votes
4
answers
6k
views
How do I get TotalStorageSpace or UsedStorageSpace metric from AWS RDS?
I see that AWS RDS provides a FreeStorageSpace metric for monitoring disk usage. Now I am trying to create a generic pre-emptive alert for all my RDS but setting up an ideal threshold on ...
- 9,363
7
votes
1
answer
3k
views
Container disk usage in DataDog
Is there any way to monitor disk usage of docker containers in DataDog?
I can see in DataDog web all the CPU, RAM and IO metrics for my containers.
But I can't see any of disk space related metrics.
...
- 9,397
7
votes
2
answers
662
views
How to choose an Opentelemetry backend vendor?
With Opentelemetry becoming the new standard of tracing, and it being vendor-agnostic, how do we then choose a backend vendor for opentelemetry?
For example, there are currently many vendors that ...
- 159
7
votes
1
answer
3k
views
datadog API python auth
Is there a basic example of how to authenticate to datadog using the python lib datadog_api_client.v2? I was looking at their documentation https://datadoghq.dev/datadog-api-client-python/v2/#...
- 529
7
votes
1
answer
2k
views
pino-datadog-transport with Next.js on Vercel
I'm trying to migrate a Next.js project running on Vercel from
"pino-datadog": "2.0.2",
"pino-multi-stream": "6.0.0",
to
"pino": "8....
- 1,051
7
votes
0
answers
3k
views
Getting Infrastructure metrics from AWS Batch to DataDog
Is there a direct integration point or a connector to integrate an AWS Batch job with DataDog? To retrieve the logs and infrastructure metrics?
So far what I came across was the DataDog forwarder ...
- 157
7
votes
0
answers
1k
views
Datadog monitor to alert when one metric hasn't happened within a period of time since another metric
I'm having trouble setting up monitor that will alert me when an event hasn't happened since some period of time following another event. Basically, for a given task in my application, I have a log ...
- 121
6
votes
1
answer
3k
views
DataDog events are auto-recovered
I created an event monitor that catches events with errors and notifies about the alert in a special messenger. Everything worked out for me, but I noticed that such alerts are auto-recovered on their ...
- 163
6
votes
3
answers
4k
views
does else exist on datadog is_match
I am trying to set up slack monitors with datadog, based on the environment.
For e.g. if the environment is production got to slack channel A and if it is uat go to slack channel B and all other ...
6
votes
1
answer
6k
views
Datadog % Mem Usage and RSS Memory
We have a .net core service running inside a docker container which is used for processing files uploaded by user. Some of the incoming requests are with files as large as 20 MB. The application saves ...
- 323
6
votes
1
answer
2k
views
Is DataDog tag value converted to lower case with underscores?
I push a custom tag to DataDog with key of execute_error and value of "testing DATADOG mApPeR OK"
However, when I check on the DataDog, it looks like the tag is mapped into "...
- 63
6
votes
3
answers
8k
views
How to log to a file in asp.net core web app - wtihout any third party tools
I am currently have an application running where I want the logs to be sinked into a file, such that Datadog is able to fetch them.
I currently just uses the sourcegenerator to log, but how do i get ...
- 417
6
votes
2
answers
3k
views
How do you pass file_system_blacklist arg to Datadog Docker Agent run command?
I want to exclude a path to avoid getting my logs spammed like so:
(disk.py:75) | Unable to get disk metrics for /host/proc/sys/fs/binfmt_misc:
[Errno 40] Too many levels of symbolic links:
'/...
- 1,065
6
votes
1
answer
2k
views
Datadog: Notify about every new log-item with error-level
Is it possible to configure datadog to notify about each new error that got logged?
I know how to set a threshold for a specified period and how to send the error-count for instance to slack. But I ...
- 3,035
6
votes
1
answer
1k
views
Why is my DataDog instance reporting a Kubernetes "no_pod"?
We are running a Kubernetes Cluster in AWS and we are collecting the metrics in DataDog using the dd-agent DaemonSet.
We have a Pod being displayed in our metrics tagged as "no_pod" and it is using a ...
- 1,309