Materia TS

Materia is a new serverless databases offering by Clever Cloud. A whole range of services meeting the needs expressed by our customers in recent years, with an open and resilient approach. It includes deployment across multiple availability zones, compatibility with existing protocols, clients, and pay-as-you-go billing. It’s built on the FoundationDB open source transactional engine. A distributed and robust solution, notably thanks to its high simulation capacity.

Materia TS is the time series database of this family. It comes with simplicity in mind. You have no instance size to choose, no storage capacity to worry about. We simply provide you with a host address, a port and a token: you’re ready to go! Once our servers send a reply message, your data is durable: it’s synchronously replicated over 3 data centers in Paris.

You don’t have to configure leaders, followers: high availability is included, by design.

Main concepts

Warp 10 is a time series database, it uses the notion of class, labels, longitude, latitude, altitude and value. labels is a kind of dictionary. That’s called a map under the warp10 terminology.

A GeoTime Serie (GTS) is defined by a class and some labels. They’re indexed and used to quickly retrieved the data. A GTS may contain some values which have the following model: [ timestamp longitude latitude altitude value ]

Warp 10 uses Warp Script. It’s a stack based language using reverse polish notation.

• Warp 1O documentation
• Warp Script documentation

Create a Materia TS add‑on

To create a Materia TS add-on, use the Console or the following command in Clever Tools:

clever addon create ts myTS --org <your_org_id>

The add-on is immediately created and you can start using it with provided tokens.

Using your Materia TS add-on

Materia TS uses Warp10 time series engine and WarpsScript query language. It provides PromQL and Prometheus Ingestion gateway in addition to warp10 endpoints. You can also use Time Series Language (TSL) previously written by OVHcloud Metrics team.

For complete technical documentation on Warp 10 and its query language, see our Warp 10 documentation.

Time and duration in Warp 10

The platform’s time unit is in microsecond.

• Learn more about date functions
• Learn more about time functions

Duration is set by the followings symbols

• d: day
• h: Hour
• ms: millisecond
• ns: nanosecond
• ps: picosecond
• s: second
• us: microsecond
• w: week

Date

Allowed format:

• ISO8601
• Timestamp in microsecond

Builtin function:

• NOW: get the current timestamp
• ISO8601: Convert a string or a timestamp to a ISO8601 date format

Technical constraints

The followings limits are defined in Warp 10. The soft limit can be passed over by an AUTHENTICATE operation. Operations over soft limits may be intensive. The hard limit is unsurpassable.

Usage

An example where it is needed to increase the fetch limit by the LIMIT function

'<READTOKEN>' AUTHENTICATE
50e6 TOLONG LIMIT
// Fetch on the 'accessLogs' class for your application id as labels
[ '<READTOKEN>' 'accessLogs' { 'app_id' '<APP_ID>'  } NOW 1 w ] FETCH

Visualization and exploration

Quantum

Quantum is a web tool used to run some WarpScript. You can access to it from your metrics interface.

It provides the path to the Clever Cloud Warp 10 gateway and let you explore your data.

Classes Reference

In Warp 10, classes organize metrics from various sources, like applications or add-ons, into specific categories (CPU usage, memory statistics, etc.). This structure makes the data easy to retrieve and analyze with WarpScript.

For a complete list of Telegraf classes and their descriptions, see the classes list.

Macro

Warp 10 provide a server side macro manager. It is a way to release some ready to use WarpScript. Hence, Clever Cloud provides some macros as helpers to avoid redundant and often need code.

• Warp 10’ macros documentations

Consumption

The following macros are helpers to compute consumption in seconds

• app_consumption

Return the consumption in second by applications for a specific organisation. Start and End parameters can be either a timestamp in microseconds or an iso8601 date format.

'<READ TOKEN>' '<ORGANISATION ID>' '<START>' '<END>' @clevercloud/app_consumption

• orga_consumption

Return all the consumption in second for a specific organisation. Start and End parameters can be either a timestamp in microseconds or an iso8601 date format.

'<READ TOKEN>' '<ORGANISATION ID>' '<START>' '<END>' @clevercloud/app_consumption