Intellectual Property

Patent

  • Motoyuki Aoi, Maiko Akatsu, Nanase Miura, Shinji Sako, "Word determination system",Japanese Patent Application No. 2018-048022, Mar. 2018.
  • Eizaburo Iwata, and Shinji Sako, "Intoxication State Determination Device and Intoxication State Determination Method", JP-A-2011-553634, WO/2012/014301, PCT/JP2010/062776, Universal Robot Co., Ltd. and Nagoya Institute of Technology, Jul. 2010.
  • Shigeki Sagayama, Takeya Saikachi, Shinji Sako, Yasuhiko Matsumoto, and Takuya Nishimoto, "Method and Device for Speech Synthesis", JP-A-2007-114355, The University of Tokyo, May. 2007.
  • Tatsuhiko Yamaguchi, Shinji Sako, Hiroshi Yamamoto, and Genichiro Kikui, "Speech Recognition Device and Computer Program", JP-A-2005-84436, Advanced Telecommunications Research Institute International (ATR), Mar. 2005.

Award and Press

Awards

  • 10th Mar 2016, 78th National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award
    (Naoto Sato, Shinji Sako, Tadashi Kitamura))
  • Mar. 2014, The Tokai Chapter of ASJ (Acoustical Society of Japan), Activities Award
  • 13th Mar 2014, 76th National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award
    (Kana Miyata, Shinji Sako, Tadashi Kitamura))
  • 13th Mar 2014, 76th National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award (A. Zukawa, Shinji Sako, Tadashi Kitamura))
  • Sep. 2013, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    (Ryuichi Yamamoto, Shinji Sako, Tadashi Kitamura))
  • Sep. 2013, Forum on Information Technology (FIT) Student Encouragement Award
    (Wakana Nagata, Shinji Sako, Tadashi Kitamura))
  • 19th May. 2013, Tokai Chapter of IPSJ (Information Processing Society of Japan), Student Paper Award
    (Kenta Okumura, Shinji Sako, Tadashi Kitamura)
  • 22th Jan. 2013, Tokai-Section Joint Conference on Electrical and Related Engineering, Student Encouragement Award
    (Wakana Nagata, Shinji Sako, Tadashi Kitamura) )
  • 12th Dec. 2012, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    (Ryuichi Yamamoto, Shinji Sako, Tadashi Kitamura))
  • 7th Dec. 2011, Institute of Electronics, Information and Communication Engineers (IEICE), Human Communication Group Award,
    "Improvement of HMM-based Sign Language Recognition using Phonemic Structure of Japanese Sign Language" (Shinji Sako, Koki Ariga, Tadashi Kitamura)
  • 6th Dec. 2010, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    個人性を考慮したGMMに基づいた音楽の印象推定モデル (Keiichiro Nishio, Shinji Sako, Tadashi Kitamura))
  • Mar 2010, IPSJ (Information Processing Society of Japan) Yamashita SIG Research Award
    (Satoru Fukayama, Kei Nakatsuma, Shinji Sako, Takuya Nishimoto, Shigeki Sagayama)
  • Mar 2010, National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award
    (Rio Mizuno, Shinji Sako, Tadashi Kitamura))
  • Dec. 2009, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    "重奏用譜面を生成するための経路探索を用いたメロディのパート分配" (Rio Mizuno, Shinji Sako, Tadashi Kitamura)
  • Dec. 2009, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    "Modeling and Anomaly Detection of Environmental Electromagnetic Waves Based on Patterns of Diurnal Change Using HMM" (Yuya Takase, Shinji Sako, Tadashi Kitamura))

Press

Our research results which were reported in newspaper or on TV program.

  • Yomiuri Shinbun (Newspaper), 25th Jun. 2015
    The research of synthetic speech of deceased has been introduced by major newspaper. (in Japanese)
  • WIRED UK, Sep. 2013 –Rencon: a 'Turing Test for musical expression' by Olivia Solon
    The research of artistic performance rendering and the result of RENCON 2013 has been introduced.
  • Chunichi Shinbun Evening Edition (Newspaper), 2nd May. 2012
    The research of synthetic speech of deceased has been introduced by local newspaper. (in Japanese)
  • Nagoya TV UP! Special Program, 31th Jul. 2012
    This TV program features various result of HMM-based speech synthesis technology. The research of synthetic speech of deceased has been introduced. The scene of wedding celebration when synthetic speech has been played was also introdued. (in Japanese)

Software Development

Software

  • Orpheus:  （The univeristy of Tokyo, Sagayama Laboratory）
    http://www.orpheus-music.org/v3/
  • MusicPipe: Automatic Arrangement System for Ensemble Music
    The MusicPipe is a automatic arrangement system for ensemble music. It can generate a ensemble music for an arbitrary combination of instruments.
    http://www.musicpipe.net/
  • SPTK: Speech Signal Processing Toolkit
    The Speech Signal Processing Toolkit (SPTK) is a suite of speech signal processing tools for UNIX environments, e.g., LPC analysis, PARCOR analysis, LSP analysis, PARCOR synthesis filter, LSP synthesis filter, vector quantization techniques, and other extended versions of them. This software is released under the Modified BSD license.
    http://sp-tk.sourceforge.net/
  • HTS: HMM-based Speech Synthesis System
    The HMM-based Speech Synthesis System (HTS) has been developed by the HTS working group and others. The training part of HTS has been implemented as a modified version of HTK and released as a form of patch code to HTK. The patch code is released under a free software license. However, it should be noted that once you apply the patch to HTK, you must obey the license of HTK. Related publications about the techniques and algorithms used in HTS can be found here.
    http://hts.sp.nitech.ac.jp/
  • Galatea Project ( Anthropomorphic Spoken Dialog Agent Toolkit)
    This project providing an open-source toolkit for anthropomorphic spoken dialogue agent with which one can develope a life-like animated agent that talks with the user and can be easily customized with the face, voice, and dialog grammar.
    https://osdn.jp/projects/galatea/
  • Galatea Talk: Japanese speech synthesis software
    http://galateatalk.sourceforge.jp/

Research Databases

  • M2TINIT: Japanese multi-modal speech database
    M2TINIT is japanese multi-modal database which was developped by Tokyo Institute of Technology and Nagoya Institute of Technology. This database consists of speech and movie (bottom of face) for 503 Japanese phonetically balanced sentence. This database is free-of-charge for academic purposes.
    http://m2tinit.sp.nitech.ac.jp/

 

Research Grant

Grant-in-Aid for Scientific Research (KAKENHI, The Ministry of Education, Culture, Sports, Science and Technology)

  • Grant-in-Aid for Young Scientists  (B), Subject No. 21700191, "A study on trainable singing voice synthesis system capable of representing personal characteristics and singing styles", Apr. 2009 – Mar 2012 (3 years), Principal Researcher
  • Grant-in-Aid for Scientific Research (C), Subject No. 22500506, Supervisor: Tadashi Kitamura, Research on sign subunit technique using statistical model for large vocabulary continuous sign language recognition", Apr. 2010 - Mar 2013 (3 years), Co-researcher (Principal Researcher: Tadashi Kitamura)
  • Grant-in-Aid for Scientific Research (C), Subject No. 25350666, "Research on sign subunit technique using statistical model for large vocabulary continuous sign language recognition", Apr. 2013 – Mar 2016 (3 years), Co-researcher (Principal Researcher: Tadashi Kitamura)
  • Grant-in-Aid for Young Scientists (B), Subject No. 26730182, "Research on automatic performance rendering and Coordinated accompaniment system", Apr. 2014 – Mar 2017 (3 years), Principal Researcher
  • Grant-in-Aid for Fostering Joint International Research, Subject No. 15KK00008, Apr. 2016 – Mar. 2018. (3 years), Principal Researcher
  • Grant-in-Aid for Scientific Resaerch (S), Subject No. 17H06114, "Research on development of multi-purpose Japanese Sign Language Database", Jul. 2017 – Mar. 2021, Co-Resaercher (Principal Researcher: Prof. Yuji Nagashima)
  • Grant-in-Aid for Challenging Exploratory Research, Subject No. 18K18698, "A Basic Study on the Production and Use of Sound Information by Tapping with a White Cane for the Visually Impaired", Jul. 2018 – Mar. 2022 (extended), Co-Researcher (Principal Researcher: Prof. Kiyohiko Nunokawa)

Competitive Research Grant

  • ASTEP: Adaptable and Seamless Technology Transfer Program through Target-Driven R&D, FS stage, Subject No. AS231Z02560A, "Study of the Kansei estimation model from music signal based on a statistical model depend on user's preference", Aug. 2011 – Mar 2012 (8 months), Principal Researcher
  • ASTEP: Adaptable and Seamless Technology Transfer Program through Target-Driven R&D, FS stage, Subject No. AS251Z01921H, Aug. 2013 – Mar 2014 (8 months), Principal Researcher
  • ASTEP: Adaptable and Seamless Technology Transfer Program through Target-Driven R&D, FS stage, Subject No. AS262Z00622H , Jan. 2015 – Dec. 2015, Principal Researcher

Scholarship

Other Grant

  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "A research on statistical modeling method for characteristics of performer", Apr. 2010 – Mar. 2011 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on performance generation method based on musical interpretation", Apr. 2011 – Mar. 2012 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on collaborative performance system based on musical expression", Apr. 2012 – Mar. 2013 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on automatic fingering estimation for violin", Apr. 2013 – Mar. 2014 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on music performance rendering", Apr. 2014 – Mar. 2015 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Exploratory Research , "Research on sign language recognition using non-manual signal", Apr. 2015 – Mar. 2016 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Exploratory Research, "A research on  motion tracking  using first-person video for sign language recognition", Apr.2021 – Mar. 2022 (1 year), Principal Researcher

Joint Research

Travel Grant