Workshop Program

09:20 09:30 Workshop opening and welcome
09:30 10:00 Invited Speaker: Frederic Ronga
Nestlé Research Center, Lausanne, Switzerland
Personalized Nutrition in the connected era: challenges and opportunities
10:00 10:15 Deep Cooking: Predicting Food Ingredient Amounts from Images
Jiatong Li (Rutgers University); Ricardo Guerrero (Samsung AI Center); Vladimir Pavlovic (Rutgers University)
10:15 10:30 Impact of Mixed Reality Food Labels on Product Selection: Insights from a User Study using Headset-mediated Food Labels at a Vending Machine
Klaus Fuchs (ETH Zurich); Tobias Grundmann (ETH Zurich); Mirella Haldimann (ETH Zurich);Elgar Fleisch (ETH Zurich)
10:30 11:00 Coffee Break
11:00 11:30 Invited Speaker: Ramesh Jain
University of California, USA and Peng Cheng Lab, China
Eat, Drink and be Happy
11:30 12:00 Invited Speaker: Karan Sikka
SRI International, USA
Learning User Preferences from Social Multimedia Analysis and Overview of the iFood2019 Challenge
12:00 12:15 Unseen Food Creation by Mixing Existing Food Images with Conditional StyleGAN
Daichi Horita (The University of Electro-Communications); Wataru Shimoda (The University of Electro-Communications); Keiji Yanai (The University of Electro-Communications)
12:15 12:30 Self-Attention and Ingredient-Attention Based Model for Recipe Retrieval from Image Queries
Matthias Fontanellaz (ARTORG Center for Biomedical Engineering Research); Stergios Christodoulidis (ARTORG Center for Biomedical Engineering Research); Stavroula Mougiakakou (ARTORG Center for Biomedical Engineering Research)
12:30 14:00 Lunch Break
14:00 14:30 Invited Speaker: Kiyoharu Aizawa
The University of Tokyo, Japan
FoodLog: Multimedia Food Recording Platform and its Application for Athletes’ Nutrition Management
14:30 14:45 Convolutional Neural Networks for Food Image Recognition: An Experimental Study
Yi Sen Ng (National University of Singapore); Wanqi Xue (National University of Singapore); Wei Wang (National University of Singapore); Panpan Qi (National University of Singapore)
14:45 15:00 Categorization of Cooking Actions Based on Visual Similarity
Yixin Zhang (Kyoto University); Yoko Yamakata (The University of Tokyo);Keishi Tajima (Kyoto University)
15:00 15:15 Scraping Social Media Photos Posted in Kenya and Elsewhere to Detect and Analyze Food Types
Mona Jalal (Boston University); Kaihong Wang (Boston University); Jefferson Sankara (Lori Systems); Yi Zheng (Boston University); Elaine O. Nsoesie (Boston University); Margrit Betke (Boston University)
15:15 15:30 Flavour Enhanced Food Recommendation
Nitish Nag (University of California, Irvine); Aditya Narendra Rao (PES University, Bangalore); Akash Kulhalli (PES University, Bangalore); Kushal Samir Mehta (PES University, Bangalore); Nishant Bhattacharya (PES University, Bangalore); Pratul Ramkumar, Aditya Bharadwaj (PES University, Bangalore); Dinkar Sitaram (PES University, Bangalore); Ramesh Jain (University of California, Irvine)
15:30 16:00 Coffee break
16:00 17:30 Poster & Demo Session
Towards Tailoring Digital Food Labels: Insights of a Smart-RCT on User-specific Interpretation of Food Composition Data
Klaus Fuchs (ETH Zurich); Timothée Barattin (ETH Zurich); Mirella Haldimann (ETH Zurich); Alexander Ilic (ETH Zurich)
DepthCalorieCam: A Mobile Application for Volume-Based FoodCalorie Estimation using Depth Cameras
Yoshikazu Ando (The University of Electro-Communications); Takumi Ege (The University of Electro-Communications); Jaehyeong Cho (The University of Electro-Communications); Keiji Yanai (The University of Electro-Communications)
A New Large-scale Food Image Segmentation Dataset and Its Application to Food Calorie Estimation Based on Grains of Rice
Takumi Ege (The University of Electro-Communications); Wataru Shimoda (The University of Electro-Communications); Keiji Yanai (The University of Electro-Communications)
Deep Cooking: Predicting Food Ingredient Amounts from Images
Jiatong Li (Rutgers University); Ricardo Guerrero (Samsung AI Center); Vladimir Pavlovic (Rutgers University)
Impact of Mixed Reality Food Labels on Product Selection: Insights from a User Study using Headset-mediated Food Labels at a Vending Machine
Klaus Fuchs (ETH Zurich); Tobias Grundmann (ETH Zurich); Mirella Haldimann (ETH Zurich);Elgar Fleisch (ETH Zurich)
Unseen Food Creation by Mixing Existing Food Images with Conditional StyleGAN
Daichi Horita (The University of Electro-Communications); Wataru Shimoda (The University of Electro-Communications); Keiji Yanai (The University of Electro-Communications)
Self-Attention and Ingredient-Attention Based Model for Recipe Retrieval from Image Queries
Matthias Fontanellaz (ARTORG Center for Biomedical Engineering Research);Stergios Christodoulidis(ARTORG Center for Biomedical Engineering Research); Stavroula Mougiakakou (ARTORG Center for Biomedical Engineering Research)
Convolutional Neural Networks for Food Image Recognition: An Experimental Study
Yi Sen Ng (National University of Singapore); Wanqi Xue (National University of Singapore); Wei Wang (National University of Singapore); Panpan Qi (National University of Singapore)
Categorization of Cooking Actions Based on Visual Similarity
Yixin Zhang (Kyoto University); Yoko Yamakata (The University of Tokyo);Keishi Tajima (Kyoto University)
Scraping Social Media Photos Posted in Kenya and Elsewhere to Detect and Analyze Food Types
Mona Jalal (Boston University); Kaihong Wang (Boston University); Jefferson Sankara (Lori Systems); Yi Zheng (Boston University); Elaine O. Nsoesie (Boston University); Margrit Betke (Boston University)
Flavour Enhanced Food Recommendation
Nitish Nag (University of California, Irvine); Aditya Narendra Rao (PES University, Bangalore); Akash Kulhalli (PES University, Bangalore); Kushal Samir Mehta (PES University, Bangalore); Nishant Bhattacharya (PES University, Bangalore); Pratul Ramkumar, Aditya Bharadwaj (PES University, Bangalore); Dinkar Sitaram (PES University, Bangalore); Ramesh Jain (University of California, Irvine)
Ingredient-Guided Cascaded Multi-Attention Network for Food Recognition (INVITED – ACM MM2019)
Weiqing Min (Chinese Academy of Sciences); Linhu Liu (Chinese Academy of Sciences); Zhengdong Luo (Chinese Academy of Sciences); Shuqiang Jiang (Chinese Academy of Sciences)
Learning Using Privileged Information for Food Recognition (INVITED – ACM MM2019)
Lei Meng (National University of Singapore, Singapore); Long Chen (Zhejiang University); Xun Yang (National University of Singapore, Singapore); Hanwang Zhang (Nanyang Technological University, Singapore); Dacheng Tao (The University of Sydney); Chunyan Miao (Nanyang Technological University, Singapore); Tat-Seng Chua (National University of Singapore, Singapore)
Mixed-dish Recognition with Contextual Relation Networks (INVITED – ACM MM2019)
Lixi Deng (Institute of Computing Technology, Chinese Academy of Sciences); Jingjing Chen (National University of Singapore); Qianru Sun (National University of Singapore); Xiangnan He (University of Science and Technology of China); Sheng Tang (Institute of Computing Technology, Chinese Academy of Sciences); Zhaoyan Ming (National University of Singapore); Yongdong Zhang (Institute of Computing Technology, Chinese Academy of Sciences); Tat Seng Chua (National University of Singapore)
DEMO: goFOOD™ for Dietary Assessment
Ya Lu (University of Bern, Switzerland); Thomai Stathopoulou (University of Bern, Switzerland); Stavroula Mougiakakou (University of Bern, Switzerland)
DEMO: For a Dietitian Nutrition Management App: FoodLog Athlete
Miyuki Kawarada (The University of Tokyo, Japan); Hiroaki Karasawa (The University of Tokyo, Japan); Sosuke Amano (The University of Tokyo, Japan); Yoko Yamakata (The University of Tokyo, Japan); Kiyoharu Aizawa (The University of Tokyo, Japan)
DEMO: Cookpad Image To Recipe
Ryan Fox (Cookpad Ltd, UK); Mikhail Fain (Cookpad Ltd, UK); Andrey Ponikar (Cookpad Ltd, UK); Daniel Fernandez (Cookpad Ltd, UK)
DEMO: A Cooking Support System by Extracting Difficult Scenes for Cooking Operations from Recipe Short Videos (INVITED – ACM MM2019)
Takuya Yonezawa (Kwansei Gakuin University, Japan); Yuanyuan Wang (Yamaguchi University, Japan); Yukiko Kawai (Kyoto Sangyo University, Japan); Kazutoshi Sumiya (Kwansei Gakuin University, Japan)
DEMO: Ramen as You Like: Sketch-based Food Image Generation and Editing (INVITED – ACM MM2019)
Jaehyeong Cho (The University of Electro-Communications, Japan); Wataru Shimoda (The University of Electro-Communications, Japan); Keiji Yanai (The University of Electro-Communications, Japan)