$ http --follow http://localhost:4040/metrics/json \
| jq '.gauges | keys | .[] | select(test(".driver.BlockManager"; "g"))'
"local-1488272192549.driver.BlockManager.disk.diskSpaceUsed_MB"
"local-1488272192549.driver.BlockManager.memory.maxMem_MB"
"local-1488272192549.driver.BlockManager.memory.memUsed_MB"
"local-1488272192549.driver.BlockManager.memory.remainingMem_MB"
BlockManagerSource — Metrics Source for BlockManager
BlockManagerSource
is the metrics Source for BlockManager.
BlockManagerSource
is registered under the name BlockManager (when SparkContext
is created).
Name | Type | Description |
---|---|---|
|
long |
Requests |
|
long |
Requests |
|
long |
Requests |
|
long |
Requests |
You can access the BlockManagerSource
metrics using the web UI’s port (as spark.ui.port property).