Azure IoT Edge module which monitors file creation and puts the filename as messages on the IoT Edge routing

This module is forked from here, customized it for only filename monitoring.

Clone this repository by following command (or download as zip)

git clone https://github.com/yahanda/iot-edge-filewatcher.git

1. Follow the instructions to Quickstart: Create a private container registry using the Azure portal
2. After your container registry is created, browse to it, and from the left pane select Access keys from the menu located under Settings.
3. Enable Admin user and copy the values for Login server, Username, and Password and save them somewhere convenient.

1. Open git cloned folder with VS Code.
2. Update the .env with the values you made a note from Azure Container Registry.
3. Open the Visual Studio Code integrated terminal by selecting View > Terminal.
4. Sign in to Docker with the Azure container registry credentials that you saved after creating the registry.

   docker login -u <ACR username> -p <ACR password> <ACR login server>
   

5. Open the command palette and search for Azure IoT Edge: Set Default Target Platform for Edge Solution, or select the shortcut icon in the side bar at the bottom of the window.
6. In the command palette, select the target architecture from the list of options.
7. Build and Push IoT Edge Solution by right clicking on deployment.template.json file.
8. Verify deployment.json file is generated in the config folder.

1. Create Deployment for Single Device by right clicking on deployment.json file under config folder.
2. Select a targeted IoT Hub and IoT Edge device.
3. The results of your deployment are printed in the VS Code output. Successful deployments are applied within a few minutes if the target device is running and connected to the internet.

This module makes use of Docker volumes to detect and access files on disk.

Use these container create options:

{
  "HostConfig": {
    "Binds": [
      "[Host folder]:/app/exchange"
    ]
  }
}

An example is:

{
  "HostConfig": {
    "Binds": [
      "/var/iot-edge-filewatcher/exchange:/app/exchange"
    ]
  }
}

The module will automatically create the 'exchange' folder. Please give the folder elevated rights to allow renaming files after processing.

This can be done with:

sudo chmod 666 exchange

The module check the 'exchange' folder every few seconds to detect new files using a certain search pattern.

After processing, the file is renamed using a new extension which is appended to the orginal filename.

With desired properties, we can change the behavior:

• interval, the interval in milliseconds - Default 10000
• searchPattern, the pattern mapped on filenames - Default '*.txt'
• renameExtension, the appended extension to prevent a file being read twice - Default '.old'

The messages outputted are JSON messages that contains the filename (full path) and filesize (byte) of the incoming file.

06/25/2021 03:53:13 - Seen 0 files with pattern '*.txt'
06/25/2021 03:53:23 - Seen 0 files with pattern '*.txt'
06/25/2021 03:53:33 - Seen 1 files with pattern '*.txt'
File found: '/app/exchange/a.txt' - Size: 15 bytes.
Sending message: {"filename":"/app/exchange/a.txt","filesize":15}
Renamed '/app/exchange/a.txt' to '/app/exchange/a.txt.old'
06/25/2021 03:53:44 - Seen 0 files with pattern '*.txt'
06/25/2021 03:53:54 - Seen 0 files with pattern '*.txt'
06/25/2021 03:54:04 - Seen 0 files with pattern '*.txt'

Keep in mind the module needs access to the folder. Please check the console log output of the module to see if right are elevated correctly.

A simple check for access to the file is built in.

This module is tested with files available on the local file system only.

Sourcecode is available at GitHub.

An example container is available on Docker Hub.

Our project accepts GitHub pull requests :-)