Using local FieldDay projects in Shortcuts
Do you want to use your own FieldDay projects with Shortcuts? Here are the steps to create Shortcuts powered by FieldDay:
Step 1
Train a model in FieldDay
Create a project and train a model in FieldDay. Once a model is trained for your project, it's ready to be used in Shortcuts.
Step 2
Create a new shortcut
In the Shortcuts app, create a new shortcut. Hit “Add Action” and search for FieldDay. You will see a list of actions provided by FieldDay.
In the Shortcuts app, create a new shortcut. Hit “Add Action” and search for FieldDay. You will see a list of actions provided by FieldDay.
Hint: You can also select a project each time you run the shortcut for more flexibility.
Step 3
Evaluate images with the project
Next, lets try the "Evaluate Images in Project" action to run images through our project. This will gives us the predictions and confidence scores for each image. We can use the result from the "Get Project" action for evaluation.
When you tap on Images you will be able to select an image from your files.
Hint: We recommend using the "Select Photos" action to choose images from your Camera Roll. To pass the Photos to the "Evaluate Images in Project" action, simply tap and hold on Images.
Step 4
See the model predictions
We are ready to run the shortcut and see the results. To run it, hit the play button at the bottom right of the screen.
You will now see the evaluation result in the Shortcuts interface. The result includes the image you passed in, along with the predicted category and confidence score. You can choose to display the result as pages, in a list, or in a grid format.
Hint: Actions such as "Quick Look" and "Show Preview" give you the ability to customise the displayed result. The Evaluation Result provides a variety of values that you can use, including the confidence score, category name, and colour. Additionally, you can view the confidence scores for all other categories in that result.
Publish FieldDay projects to share with others
We learned that Shortcuts can find your projects from the FieldDay app. But what if you want to share a Shortcut for anyone to use? Here’s how to publish a project so anyone can use your model.
Step 1
Publish your FieldDay project
After you have trained a model in FieldDay, a share button appears in the project at the top right corner. In the export sheet, select the select the .coreml option. You will now see a "Publish Project" button. This will generate a unique code called a Project Key. This will allow others to access the model you create.
Tap the code to copy it.
Note: Any images you collected to create the model will NOT be shared.
Hint: Anyone who uses the project key will receive the latest updates whenever you make changes to your project. Meaning your shared Shortcuts will always be up to date!
Step 2
Load project in Shortcuts
Now that we have a published project, we can use the Project Key to load the model into Shortcuts. We use the "Load Project from Key" action. This will download the model file and update it whenever you make changes from FieldDay.
Hint: We recommend using the "Select Photos" action to choose images from your Camera Roll. To pass the Photos to the "Evaluate Images in Project" action, simply tap and hold on Images.
Step 3
Share the shortcut
Because you are using "Load Project from Key", you can share the shortcut using its iCloud link. Now all anyone needs to use your awesome project is the FieldDay app installed on their device.