Pular para o conteúdo principal

Generic Telegram bot for image classification using DL4J

This might be useful for someone else. Using the TelegramBots Java API I build a generic bot which you can use for any ComputationGraph you exported from a DeepLearning4J application.

The bot simple gets any image it receives and use the model to predict an output. All you have to do is ask for a BotFather key and set a few system properties:


  • bot.username: Your bot userame
  • bot.token: The bot token you got from BotFather
  • classifier.labels: The model labels separated by comma
  • classifier.modelpath: The full filesystem path to the model
  • classifier.inputformat: Input image height, width and number of channels separated by comma




How it works:

  • First you train your model using DeepLearning4J API and export it. See as example what we did in our Brazilian coin classification post;
  • Second you get a bot key using BotFather;
  • Now you can clone the code from github and build it using mvn clean package (I am considering you already have maven);
  • Finally you can run classification-bot.jar and provide the system properties according to your model. See an example:
Starting the bot in command line


You can also clone the code from my github and built it using mvn clean package. 
This is the Brazilian Coin Classsification bot in action:

The bot in action: start a chat with it and send images


Every time you send an image to the bot it will run the model against it, so be careful if the bot is added to a group!

Notice that the code is poor, but it is enough to show my model in action to others - it also only support ComputationGraph. Another problem is with the image size, telegram reduce the image size and it may lead to bad predictions! If you want to make improvements feel free to send me PullRequests.



Comentários

Postagens mais visitadas deste blog

Dancing lights with Arduino - The idea

I have been having fun with Arduino these days! In this article I am going to show how did I use an electret mic with Arduino to create a Dancing Lights circuit. Dancing Lights   I used to be an eletronician before starting the IT college. I had my own electronics maintenance office to fix television, radios, etc. In my free time I used to create electronic projects to sell and I made a few "reais" selling a version of Dancing lights, but it was too limited: it simply animated lamps using a relay in the output of a 4017 CMOS IC. The circuit was a decimal counter  controlled by a 555. 4017 decimal counter. Source in the image When I met Arduino a few years ago, I was skeptical because I said: I can do this with IC, why should I use a microcontroller. I thought that Arduino was for kids. But now my pride is gone and I am having a lot of fun with Arduino :-) The implementation of Dancing Lights with Arduino uses an electret mic to capture the sound and light leds...

Simplest JavaFX ComboBox autocomplete

Based on this Brazilian community post , I've created a sample Combobox auto complete. What it basically does is: When user type with the combobox selected, it will work on a temporary string to store the typed text; Each key typed leads to the combobox to be showed and updated If backspace is type, we update the filter Each key typed shows the combo box items, when the combobox is hidden, the filter is cleaned and the tooltip is hidden:   The class code and a sample application is below. I also added the source to my personal github , sent me PR to improve it and there are a lot of things to improve, like space and accents support.

Genetic algorithms with Java

One of the most fascinating topics in computer science world is Artificial Intelligence . A subset of Artificial intelligence are the algorithms that were created inspired in the nature. In this group, we have Genetic Algorithms  (GA). Genetic Algorithms  To find out more about this topic I recommend the following MIT lecture and the Nature of Code book and videos created by Daniel Shiffman. Genetic Algorithms using Java After I remembered the basics about it, I wanted to practice, so I tried my own implementation, but I would have to write a lot of code to do what certainly others already did. So I started looking for Genetic Algorithm libraries and found Jenetics , which is a modern library that uses Java 8 concepts and APIs, and there's also JGAP . I decided to use Jenetics because the User Guide was so clear and it has no other dependency, but Java 8. The only thing I missed for Jenetics are more small examples like the ones I will show i...