Generic Telegram bot for image classification using DL4J

This might be useful for someone else. Using the TelegramBots Java API I build a generic bot which you can use for any ComputationGraph you exported from a DeepLearning4J application.

The bot simple gets any image it receives and use the model to predict an output. All you have to do is ask for a BotFather key and set a few system properties:

bot.username: Your bot userame
bot.token: The bot token you got from BotFather
classifier.labels: The model labels separated by comma
classifier.modelpath: The full filesystem path to the model
classifier.inputformat: Input image height, width and number of channels separated by comma

How it works:

First you train your model using DeepLearning4J API and export it. See as example what we did in our Brazilian coin classification post;
Second you get a bot key using BotFather;
Now you can clone the code from github and build it using mvn clean package (I am considering you already have maven);
Finally you can run classification-bot.jar and provide the system properties according to your model. See an example:

Starting the bot in command line

You can also clone the code from my github and built it using mvn clean package.

This is the Brazilian Coin Classsification bot in action:

The bot in action: start a chat with it and send images

Every time you send an image to the bot it will run the model against it, so be careful if the bot is added to a group!

Notice that the code is poor, but it is enough to show my model in action to others - it also only support ComputationGraph. Another problem is with the image size, telegram reduce the image size and it may lead to bad predictions! If you want to make improvements feel free to send me PullRequests.

Comentários

Postagens mais visitadas deste blog

Creating custom Work Item Handler in BPM Suite/jBPM 6

Hi all! In this post I am going to share my experience creating a work item handler for BPM Suite 6.0.3 (which is very similar to jbpm as explained in a previous post ). The Hello World Work Item Handler Let's create a really simple WorkItemHandler just to print "Hello World" in the console. Of course you can implement more feature and make it receive parameters, access database, web services, etc. But in this post we will keep it simple. Really simple. First thing to do is to create a maven project for my WorkItemHandler. Here's the pom.xml of my Maven project: Notice that we are importing jbpm dependency so we can find the java interface that is used to create work item handlers. Now we can start coding. Let's create a class name HelloWorkItemHandler in package org.jugvale.jbpm, here is the simple code: Now we can build our project and go to BPM Suite to configure it so we can use this workitem. Registering the WorkItemHandler UPDATE...

Using the REST Task from jBPM 6

In this post I am going to share my experience using the BPM Suite 6 REST Task. BPM Suite X jBPM jBPM is a JBoss community project to offer an open source and efficient BPM Suite and BPM Suite is a product created by Red Hat based on jBPM. In this post I will be using BPM Suite because I have it installed already, but what I am going to described should work for jBPM as well. REST Task The REST Task is used to invoke a REST resource (or perform an HTTP Request) from your Business Process. You can set the URL, HTTP Method, timeout and credentials from the Process Modeller interface and when the process gets into that task, it will generate a HTTP Request and return the response as String. It is available on the left side pallet under the "Service Tasks" tab: The Target REST Web Service The service we are going to access from our process is a really simple one, that's why it is called simple-hello-rs and it is based on JBoss helloworld-rs qu...

Simplest JavaFX ComboBox autocomplete

Based on this Brazilian community post , I've created a sample Combobox auto complete. What it basically does is: When user type with the combobox selected, it will work on a temporary string to store the typed text; Each key typed leads to the combobox to be showed and updated If backspace is type, we update the filter Each key typed shows the combo box items, when the combobox is hidden, the filter is cleaned and the tooltip is hidden: The class code and a sample application is below. I also added the source to my personal github , sent me PR to improve it and there are a lot of things to improve, like space and accents support.

FXApps

Pesquisar este blog