Invited Talk: Tracking All Bees in the Hive: Modern Computer Vision Methods for Understanding the Interplay of Individual ...
Montag, 29. April 2019
09.00 – 10.30 Uhr
FB Informatik u. Informationswissenschaft
Prof. Dr. Tim Landgraf, Freie Universität Berlin
Tracking All Bees in the Hive: Modern Computer Vision Methods for Understanding the Interplay of Individual and Collective Behavior
Abstract: In my lab, we are studying the individual and collective intelligence of animal model systems such as fish and honeybees. By combining modern tools from robotics and machine learning, we can approach previously intractable research questions, e.g. how bees collectively process information in complex, changing environments. In project “BeesBook”, we track all bees in a colony from the day they emerge until the day they die. This way, we can closely observe each individual’s contribution to the functioning of the colony. However, we sometimes reach the limits of the technological state of the art. To decode the barcode-like markers glued to the back of each bee with modern deep convnets, we would have to label vast amounts of image data. We instead developed a new type of generative adversarial network ("RenderGAN") that learns to generate realistic images of honeybee markers with "semantic control" over the labels. A deep decoder
network trained on synthetic images outperforms decoders trained on 3D-rendered marker images. In my talk, I will present a few examples of this research cycle: from modern tools in biology to new findings, and from methodological challenges to new pieces of technology.