[PAID] MlTBRek: Offline Text and Barcode recognition [$8 or 551]

vknow360 · September 5, 2023, 2:02pm

1. Overview

The MlTBRek extension for App Inventor 2 and Kodular enables offline text recognition and barcode scanning using ML Kit. This extension offers modules for barcode and text recognition, including support for various scripts such as Latin, Devanagari, Chinese, Japanese, and Korean. Users can initialize text and barcode recognizers, install and check the availability of necessary modules, and recognize text or barcodes from images, file paths, or content URIs. The extension also provides events for handling module states, recognition results, and errors, making it a powerful tool for integrating advanced recognition features into your apps.

Latest Version: 4
Released: 2023-09-02T18:30:00Z
Last Updated: 2024-08-28T18:30:00Z
Aix Size: 1.2mb

2. Blocks

3. Documentation

Events

ModulesInstalled	Event raised when modules have been installed _{type \| number}
ModulesInstallFailed	Event raised when modules installation failed _{type \| number errorMsg \| text}
ModulesStateUpdated	Event raised when modules state changes _{type \| number state \| number progress \| number}
GotModulesState	Event raised after checking modules availability _{type \| number areModulesAvailable \| boolean}
RecognisedText	Event raised after getting text from image _{text \| text blocks \| list}
UrlScanned	Event raised if url was found in barcode _{title \| text url \| text}
ContactInfoScanned	Event raised if contact info was found in barcode _{address \| text email \| text name \| text orgName \| text phone \| text title \| text urls \| text}
EmailScanned	Event raised if email was found in barcode _{address \| text body \| text subject \| text type \| number}
WifiScanned	Event raised if wifi info was found in barcode _{ssid \| text pswd \| text encryptionType \| number}
GeoPointScanned	Event raised if geo points were found in barcode _{lat \| number lon \| number}
BarcodeScanned	Event raised when no specific type of barcode was found and given barcode was decoded in general _{rawValue \| text barFormat \| number displayValue \| text}
BarRecognitionFailed	Event raised if barcode scanning failed _{errorMsg \| text}
TextRecognitionFailed	Event raised if text recognition failed _{errorMsg \| text}

Methods

BarRecognitionModules	Modules for barcode recognition
TextRecognitionModules	Modules for text recognition _{langScript \| number}
InitTextRecognizer	Initialize Text Recognizer _{langScript \| number}
InstallModules	Install deps of given type _{type \| number}
ReleaseModules	Initiates a request to release given modules when they are no longer needed. This method notifies Google Play services that the modules are no longer needed for this app, but it does not guarantee the modules can be removed. Google Play services will try to clean up the modules when they are not used by any apps. _{type \| number}
CheckModulesAvailability	Checks given modules availability _{type \| number}
RecogniseText	Tries to recognize test from given input that can be an Image component, file path or content uri _{image \| any}
InitBarRecognizer	Initializes Barcode recognizer/scanner
RecogniseBarcode	Tries to decode barcode from given input which can be an Image component, file path or content uri _{image \| any}

Properties

DefaultScript	Property Type : read-only Accepts : number
DevanagariScript	Property Type : read-only Accepts : number
ChineseScript	Property Type : read-only Accepts : number
JapaneseScript	Property Type : read-only Accepts : number
KoreanScript	Property Type : read-only Accepts : number

4. Usages

Install required modules

Check modules availability

Text Recognisation
First initialize recognizer.

Then provide input image to RecogniseText block.

RecognisedText event will be raised with result if recognition was successful otherwise TextRecognitionFailed event will be raised with error message.

blocks is a list of dictionaries. Each dictionary contains following keys:
- text : complete text
- lines : a list of lines
- angles : a list of angles corresponding to each line
- confidences : a list of confidence values corresponding to each line

All major language scripts are supported.

Latin
Devanagari
Chinese
Japanese
Korean

Barcode Recognition

Initialize Barcode recogniser.

Then provide input image to RecogniseBarcode block.

Result will be delivered via different events based upon type of barcode.

It can read following barcode formats:

1D barcodes: EAN-13, EAN-8, UPC-A, UPC-E, Code-39, Code-93, Code-128, ITF, Codabar
2D barcodes: QR Code, Data Matrix, PDF-417, AZTEC

It automatically parses QR Codes, Data Matrix, PDF-417, and Aztec values, for the following supported formats:

URL
Contact information (VCARD, etc.)
WiFi
Geo-location (latitude and longitude)
Email

more will be added on demand.

5. Demo Video

6. Purchase

Thank you.
Hope it helps!

vknow360 · October 26, 2023, 9:47am

ChangeLog Version 2

Rename extension to MlTBRek from SimpleRecognition
Some new blocks added and few blocks removed
Upgrade to ML Kit
Brings dynamic deps management and thus effectively reducing aix size to just 1.1mb
Major internal changes wherever there was room for improvement
Recognise blocks can accept Image component, File Path or Content Uri
Completely offline purchase verification

vknow360 · May 4, 2024, 1:00pm

ChangeLog Version 3

Aix size reduced to 1 mb
Extension won’t crash Companion now
Though none of its blocks will work.
No-conflict version to resolve deps conflict with my other ML Kit extensions like ImageLabelling and ScanKit

vknow360 · August 30, 2024, 6:49am

ChangeLog Version 4

Extension has been completely re-written so create a backup of imp projects before importing new version
Added Chinese, Japanese and Korean language script supported to extension
Updated Text Recognition (19.0.1) and Bar Recognition (18.3.1) SDKs
Added license key property so no need to upload license to assets now