{"id":247,"date":"2025-11-20T15:07:34","date_gmt":"2025-11-20T15:07:34","guid":{"rendered":"https:\/\/codetypingpro.com\/?p=247"},"modified":"2025-11-20T15:07:34","modified_gmt":"2025-11-20T15:07:34","slug":"37-real-world-python-projects-iot-data-logger","status":"publish","type":"post","link":"https:\/\/codetypingpro.com\/?p=247","title":{"rendered":"37 – Real-World Python Projects – IoT Data Logger"},"content":{"rendered":"\n
<\/h6>\n\n\n\n

Purpose<\/strong><\/h3>\n\n\n\n

A Python-based system that collects data from real sensors (temperature, humidity, motion, gas, etc.), processes it, and stores it in:<\/p>\n\n\n\n

\u2714 Local CSV
\u2714 Local SQLite database
\u2714 Cloud platform (Firebase \/ MQTT \/ Thingspeak)<\/p>\n\n\n\n

This is a must-know IoT project<\/strong> used everywhere\u2014homes, factories, agriculture, vehicles, warehouses.<\/p>\n\n\n\n

\n\n\n\n

\ud83e\udde0 What You Will Build<\/strong><\/h1>\n\n\n\n

A system that:<\/p>\n\n\n\n

    \n
  1. Connects to sensors (via Arduino\/ESP32\/Raspberry Pi)<\/li>\n\n\n\n
  2. Receives sensor readings via Serial\/WiFi\/MQTT<\/li>\n\n\n\n
  3. Stores readings into CSV + SQLite<\/li>\n\n\n\n
  4. Generates automatic daily report<\/li>\n\n\n\n
  5. Visualizes data (temperature graph)<\/li>\n<\/ol>\n\n\n\n
    \n\n\n\n

    \ud83e\uddf0 Tech Stack<\/strong><\/h1>\n\n\n\n
      \n
    • Python<\/li>\n\n\n\n
    • PySerial (for reading sensor data)<\/li>\n\n\n\n
    • SQLite3<\/li>\n\n\n\n
    • Pandas<\/li>\n\n\n\n
    • Matplotlib<\/li>\n\n\n\n
    • (Optional) MQTT, Firebase<\/li>\n<\/ul>\n\n\n\n
      \n\n\n\n

      \ud83d\udce1 Example Hardware Setup<\/strong><\/h1>\n\n\n\n

      You can use any one:<\/p>\n\n\n\n

      Option A: Arduino + DHT11\/22 Sensor<\/strong><\/h3>\n\n\n\n

      Arduino \u2192 USB \u2192 Python<\/p>\n\n\n\n

      Option B: ESP32\/NodeMCU (WiFi)<\/strong><\/h3>\n\n\n\n

      ESP32 \u2192 MQTT \u2192 Python<\/p>\n\n\n\n

      Option C: Raspberry Pi (direct GPIO)<\/strong><\/h3>\n\n\n\n

      Python directly reads sensors<\/p>\n\n\n\n

      \n\n\n\n

      \ud83d\udcc1 Folder Structure<\/h1>\n\n\n\n
      IoT_DataLogger\/\n\u2502\u2500\u2500 datalogger.py\n\u2502\u2500\u2500 sensor_reader.py\n\u2502\u2500\u2500 database.db\n\u2502\u2500\u2500 logs\/\n\u2502    \u2514\u2500\u2500 data_2025-11-20.csv\n<\/code><\/pre>\n\n\n\n
      \n\n\n\n
      \ud83e\udde9 FULL WORKING PYTHON CODE<\/strong><\/h1>\n\n\n\n
      \ud83d\udccc Part 1 \u2014 Read Sensor Data via Serial (sensor_reader.py)<\/strong><\/h2>\n\n\n\n
      import serial\nimport time\n\ndef read_sensor(port=\"COM3\", baud=9600):\n    ser = serial.Serial(port, baud, timeout=1)\n    time.sleep(2)\n\n    while True:\n        line = ser.readline().decode().strip()\n        if line:\n            return line\n<\/code><\/pre>\n\n\n\n
      Your Arduino should print something like:<\/p>\n\n\n\n
      25.7, 60.2    # temperature, humidity\n<\/code><\/pre>\n\n\n\n
      \n\n\n\n
      \ud83d\udccc Part 2 \u2014 Data Logger (datalogger.py)<\/strong><\/h2>\n\n\n\n
      import pandas as pd\nimport sqlite3\nfrom datetime import datetime\nfrom sensor_reader import read_sensor\n\ndef init_db():\n    conn = sqlite3.connect(\"database.db\")\n    cur = conn.cursor()\n    cur.execute(\"\"\"\n        CREATE TABLE IF NOT EXISTS sensor_logs(\n            id INTEGER PRIMARY KEY AUTOINCREMENT,\n            timestamp TEXT,\n            temperature REAL,\n            humidity REAL\n        )\n    \"\"\")\n    conn.commit()\n    conn.close()\n\ndef log_to_db(temp, hum):\n    conn = sqlite3.connect(\"database.db\")\n    cur = conn.cursor()\n    cur.execute(\"INSERT INTO sensor_logs(timestamp, temperature, humidity) VALUES (?, ?, ?)\",\n                (datetime.now(), temp, hum))\n    conn.commit()\n    conn.close()\n\ndef log_to_csv(temp, hum):\n    date = datetime.now().strftime(\"%Y-%m-%d\")\n    filename = f\"logs\/data_{date}.csv\"\n    df = pd.DataFrame([[datetime.now(), temp, hum]],\n                      columns=['Timestamp', 'Temperature', 'Humidity'])\n    df.to_csv(filename, mode='a', header=not pd.io.common.file_exists(filename), index=False)\n\ninit_db()\n\nprint(\"Starting IoT Data Logger...\")\n\nwhile True:\n    data = read_sensor()\n    temp, hum = map(float, data.split(\",\"))\n\n    log_to_db(temp, hum)\n    log_to_csv(temp, hum)\n\n    print(f\"Logged \u2192 Temp: {temp}\u00b0C, Humidity: {hum}%\")\n<\/code><\/pre>\n\n\n\n
      \n\n\n\n
      \ud83d\udcca Graph Generator (optional)<\/strong><\/h1>\n\n\n\n
      import pandas as pd\nimport matplotlib.pyplot as plt\n\ndf = pd.read_csv(\"logs\/data_2025-11-20.csv\")\nplt.plot(df['Timestamp'], df['Temperature'])\nplt.xticks(rotation=45)\nplt.title(\"Temperature Trend\")\nplt.xlabel(\"Time\")\nplt.ylabel(\"Temperature (\u00b0C)\")\nplt.tight_layout()\nplt.show()\n<\/code><\/pre>\n\n\n\n
      \n\n\n\n
      \ud83d\ude80 Optional Cloud Integrations<\/strong><\/h1>\n\n\n\n
      \u2714 MQTT Publisher (Python)<\/h2>\n\n\n\n
      Send data to an IoT cloud dashboard:<\/p>\n\n\n\n
      pip install paho-mqtt\n<\/code><\/pre>\n\n\n\n
      Code:<\/p>\n\n\n\n
      import paho.mqtt.client as mqtt\n\nclient = mqtt.Client()\nclient.connect(\"broker.hivemq.com\", 1883)\nclient.publish(\"sameer\/home\/temperature\", temp)\n<\/code><\/pre>\n\n\n\n
      \n\n\n\n
      <\/h1>\n","protected":false},"excerpt":{"rendered":"
      Purpose A Python-based system that collects data from real sensors (temperature, humidity, motion, gas, etc.), processes it, and stores it in: \u2714 Local CSV\u2714 Local SQLite database\u2714 Cloud platform (Firebase \/ MQTT \/ Thingspeak) This is a must-know IoT project used everywhere\u2014homes, factories, agriculture, vehicles, warehouses. \ud83e\udde0 What You Will Build A system that: \ud83e\uddf0 […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-247","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/codetypingpro.com\/index.php?rest_route=\/wp\/v2\/posts\/247","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/codetypingpro.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/codetypingpro.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/codetypingpro.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/codetypingpro.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=247"}],"version-history":[{"count":1,"href":"https:\/\/codetypingpro.com\/index.php?rest_route=\/wp\/v2\/posts\/247\/revisions"}],"predecessor-version":[{"id":248,"href":"https:\/\/codetypingpro.com\/index.php?rest_route=\/wp\/v2\/posts\/247\/revisions\/248"}],"wp:attachment":[{"href":"https:\/\/codetypingpro.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=247"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/codetypingpro.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=247"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/codetypingpro.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=247"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}