Timestamp for Sensor Type 1

powerna · August 28, 2024, 2:59am

I have 10 Type 1 (temperature/humidity) Sensors split on 2 Gateways. I have the readings saving to a CSV and have published a dashboard. There are 2 issues however.

1: insert the timestamp in the CSV row

I can see the timestamp in the complete message object in 2 locations, but I cannot figure out how to have this time save in the file.

2: save (or display) the temperature in Fahrenheit instead of Celsius

Dashboard users would like to see temp in F so they do not have to convert.

Any advice on these subjects would be greatly appreciated.

TravisE_NCD_Technica · August 28, 2024, 1:24pm

Can you share your Node-Red flow so we can take a look?

powerna · August 28, 2024, 9:04pm

flows.json (64.5 KB)
See attached flow.
The node I have to test are labeled "Time, function 6, Sensor4 test (csv), Sensor 4 test (write file)

TravisE_NCD_Technica · August 29, 2024, 3:03pm

I don’t have one of these sensors at my desk at the moment. Can you do me a favor and attach a debug node to the output of one of the wireless device nodes, make sure the debug node is set to output complete message object. Then send me the output from that debug node when the sensor transmits. I can create an inject node from that to use for testing.

It looks like all of the function nodes are currently empty. Have you not attempted to obtain the timestamp yet? It’s a simple Javascript function to do that.

Thank you,
Travis

TravisE_NCD_Technica · August 29, 2024, 3:07pm

Perhaps a simple modification to this flow will do what you need:

github.com

ncd-io/Node-Red-Flow-CSV-Dashboard/blob/main/flows-21.json

[{"id":"f3083b5c.3de73","type":"tab","label":"Flow 4","disabled":true,"info":""},{"id":"14b19119.779a0f","type":"ncd-gateway-node","z":"f3083b5c.3de73","name":"","connection":"3a674906.5b9e76","unknown_devices":0,"outputs":1,"x":350,"y":400,"wires":[["114d6fec.ef6238"]]},{"id":"3304074.d82dcf8","type":"function","z":"f3083b5c.3de73","name":"","func":"var obj1 = {};\nobj1.payload = msg.payload.sensor_data;\nobj1.payload.timestamp = msg.payload.received;\nobj1.filename = \"/root/\"+msg.payload.addr.replace(/:/g, \"\")+\".csv\"\nvar obj2 = {};\nobj2.payload = msg.payload.sensor_data.temperature;\nvar obj3 = {};\nobj3.payload = msg.payload.sensor_data.humidity;\n\nreturn [obj1,obj2,obj3];","outputs":3,"noerr":0,"initialize":"","finalize":"","x":730,"y":400,"wires":[["29a4a1eb.7604e6"],["d36ce4f4.6840e"],["c80aad56.0b67"]]},{"id":"114d6fec.ef6238","type":"switch","z":"f3083b5c.3de73","name":"","property":"payload.addr","propertyType":"msg","rules":[{"t":"eq","v":"00:13:a2:00:41:f0:48:13","vt":"str"},{"t":"eq","v":"","vt":"str"}],"checkall":"true","repair":false,"outputs":2,"x":560,"y":400,"wires":[["3304074.d82dcf8","9140f703.53e138"],[]]},{"id":"29a4a1eb.7604e6","type":"csv","z":"f3083b5c.3de73","name":"","sep":",","hdrin":false,"hdrout":"once","multi":"one","ret":"\\n","temp":"timestamp,temperature,humidity","skip":"0","strings":true,"include_empty_strings":"","include_null_values":"","x":930,"y":360,"wires":[["c4cd42dc.f1624"]]},{"id":"c4cd42dc.f1624","type":"file","z":"f3083b5c.3de73","name":"","filename":"","appendNewline":false,"createDir":true,"overwriteFile":"false","encoding":"none","x":1090,"y":360,"wires":[["3d3f8ca5.8772e4"]]},{"id":"d36ce4f4.6840e","type":"ui_gauge","z":"f3083b5c.3de73","name":"","group":"166a6205.a7b786","order":0,"width":0,"height":0,"gtype":"gage","title":"Temperature","label":"units","format":"{{value}}","min":"-20","max":"120","colors":["#00b500","#e6e600","#ca3838"],"seg1":"","seg2":"","x":950,"y":400,"wires":[]},{"id":"c80aad56.0b67","type":"ui_gauge","z":"f3083b5c.3de73","name":"","group":"166a6205.a7b786","order":0,"width":0,"height":0,"gtype":"gage","title":"Humidity","label":"units","format":"{{value}}","min":"0","max":"100","colors":["#00b500","#e6e600","#ca3838"],"seg1":"","seg2":"","x":940,"y":440,"wires":[]},{"id":"f3530b5d.496668","type":"csv","z":"f3083b5c.3de73","name":"","sep":",","hdrin":"","hdrout":"none","multi":"mult","ret":"\\n","temp":"","skip":"0","strings":true,"include_empty_strings":"","include_null_values":"","x":1390,"y":360,"wires":[["4c5ead34.f42264"]]},{"id":"3d3f8ca5.8772e4","type":"file in","z":"f3083b5c.3de73","name":"","filename":"","format":"utf8","chunk":false,"sendError":false,"encoding":"none","x":1250,"y":360,"wires":[["f3530b5d.496668"]]},{"id":"4c5ead34.f42264","type":"function","z":"f3083b5c.3de73","name":"","func":"var temp_readings = [];\nvar hum_readings = [];\n\nfor(i = 0; i < msg.payload.length; i++){\n    var temp_reading = {\"x\":msg.payload[i].col1, \"y\":msg.payload[i].col2};\n    var hum_reading = {\"x\":msg.payload[i].col1, \"y\":msg.payload[i].col3};\n    temp_readings.push(temp_reading);\n    hum_readings.push(hum_reading);\n}\ndata_out=[temp_readings, hum_readings];\nmsg.payload = [{\"series\":[\"Temperature\",\"Humidity\"],\"data\":data_out,\"labels\":[\"Temperature\",\"Humidity\"]}];\nreturn msg;","outputs":1,"noerr":0,"initialize":"","finalize":"","x":1560,"y":360,"wires":[["66fd74b5.9892a4"]]},{"id":"66fd74b5.9892a4","type":"ui_chart","z":"f3083b5c.3de73","name":"","group":"166a6205.a7b786","order":31,"width":0,"height":0,"label":"Chart","chartType":"line","legend":"false","xformat":"HH:mm:ss","interpolate":"linear","nodata":"","dot":false,"ymin":"","ymax":"","removeOlder":1,"removeOlderPoints":"20","removeOlderUnit":"3600","cutout":0,"useOneColor":false,"useUTC":false,"colors":["#1f77b4","#aec7e8","#ff7f0e","#2ca02c","#98df8a","#d62728","#ff9896","#9467bd","#c5b0d5"],"outputs":1,"useDifferentColor":false,"x":1710,"y":360,"wires":[[]]},{"id":"9140f703.53e138","type":"debug","z":"f3083b5c.3de73","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"false","statusVal":"","statusType":"auto","x":760,"y":320,"wires":[]},{"id":"3a674906.5b9e76","type":"ncd-gateway-config","name":"","comm_type":"serial","ip_address":"","tcp_port":"2101","port":"/dev/ttyS1","baudRate":"115200","pan_id":"7FFF","rssi":false},{"id":"166a6205.a7b786","type":"ui_group","name":"Dashboard","tab":"c829fa52.85fe48","order":1,"disp":true,"width":"6","collapse":false},{"id":"c829fa52.85fe48","type":"ui_tab","name":"Sensor Graph","icon":"dashboard","disabled":false,"hidden":false}]

Eduardo_Mtz · August 29, 2024, 4:09pm

Hi @powerna To complement @TravisE_NCD_Technica comment, I’m sharing a basic flow example. In this example, we use switch nodes to filter only sensor data and further filter by device MAC address. Subsequently, you can process the sensor data and format the date in a human-readable format. Here is the flow:

[{"id":"e00c90f3a45af11c","type":"switch","z":"f908487c97b77286","name":"sensor data","property":"topic","propertyType":"msg","rules":[{"t":"eq","v":"sensor_data","vt":"str"}],"checkall":"true","repair":false,"outputs":1,"x":570,"y":180,"wires":[["1de8cce7b7da9425"]]},{"id":"1de8cce7b7da9425","type":"switch","z":"f908487c97b77286","name":"mac","property":"payload.addr","propertyType":"msg","rules":[{"t":"eq","v":"your_device_mac","vt":"str"},{"t":"eq","v":"00:13:a2:00:42:3c:9e:1c","vt":"str"},{"t":"eq","v":"00:13:a2:00:42:3c:9e:b7","vt":"str"},{"t":"eq","v":"00:13:a2:00:42:3c:9e:af","vt":"str"}],"checkall":"true","repair":false,"outputs":4,"x":710,"y":180,"wires":[["4ac6451922017484","8562271bedc56a07"],[],[],[]]},{"id":"4ac6451922017484","type":"split","z":"f908487c97b77286","name":"","splt":"\\n","spltType":"str","arraySplt":1,"arraySpltType":"len","stream":false,"addname":"topic","property":"payload","x":910,"y":120,"wires":[["1117ef0fdde2692f"]]},{"id":"1117ef0fdde2692f","type":"switch","z":"f908487c97b77286","name":"","property":"topic","propertyType":"msg","rules":[{"t":"eq","v":"temperature","vt":"str"},{"t":"eq","v":"humidity","vt":"str"}],"checkall":"true","repair":false,"outputs":2,"x":1030,"y":120,"wires":[[],[]]},{"id":"9c64224f6b969eb1","type":"csv","z":"f908487c97b77286","name":"Sensor1","sep":",","hdrin":false,"hdrout":"once","multi":"one","ret":"\\r\\n","temp":"timestamp,temperature,humidity","skip":"0","strings":true,"include_empty_strings":"","include_null_values":"","x":1200,"y":80,"wires":[["2003911f96582a32"]]},{"id":"2003911f96582a32","type":"file","z":"f908487c97b77286","name":"Sensor 1","filename":"C:\\users\\z6finpit\\desktop\\files\\Sensor1.csv","filenameType":"str","appendNewline":false,"createDir":true,"overwriteFile":"false","encoding":"none","x":1340,"y":80,"wires":[["6d6feefac0c40f7d"]]},{"id":"6d6feefac0c40f7d","type":"debug","z":"f908487c97b77286","name":"debug 8","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"false","statusVal":"","statusType":"auto","x":1480,"y":80,"wires":[]},{"id":"7f8ae5a2c60935b1","type":"change","z":"f908487c97b77286","name":"date","rules":[{"t":"set","p":"payload.timestamp","pt":"msg","to":"$moment(payload.received).format(\"YYYY-MM-DD HH:MM:SS\")","tot":"jsonata"}],"action":"","property":"","from":"","to":"","reg":false,"x":1070,"y":80,"wires":[["9c64224f6b969eb1"]]},{"id":"8562271bedc56a07","type":"change","z":"f908487c97b77286","name":"sensor data","rules":[{"t":"set","p":"payload","pt":"msg","to":"payload.sensor_data","tot":"msg"}],"action":"","property":"","from":"","to":"","reg":false,"x":930,"y":80,"wires":[["7f8ae5a2c60935b1"]]}]

I have tested the flow, and you should see the following:

In this case, you need to use the ‘Wireless Gateway’ node to obtain all the sensor data, as shown in the screenshot below:

Inside the ‘MAC’ switch node, you should add the MAC addresses of all your devices to split the data accordingly. You can also add additional rules by clicking the ‘Add’ button.

In order to give the timestamp format, you can use the JSONata functions.

source: Anyone one convert timestamp (epoc) to formatted time string in a single change node? - General - Node-RED Forum

Please take a look and let us know if you have any questions.
Thank you,
Eduardo M.

powerna · August 30, 2024, 1:06pm

Thanks - this is what we were looking for. However, I have 2 inconsistencies in the results.

1 - time stamp only seems to update every hour

2 - not every row is receiving the correct format

Eduardo_Mtz · September 3, 2024, 9:19pm

Hi @powerna My bad, within the “date” node, in the “format” function, minutes and seconds should be in lowercase, as shown below:

$moment(payload.received).format(“YYYY-MM-DD HH:mm:ss”)

I have conducted the tests, and the date is being added correctly. Please find the attached screenshot. I apologize.

csv_file

Thank you,
Eduardo M.