Sako Web Sako Web
  • 日本語 (JP)
  • English (UK)
  • Home
  • Research
    • Topics
    • Publications
      • Journal Paper
      • Internaltional Conf.
      • Domestic Conf.
    • Grant
    • Intellectual Property
    • Award and Press
  • Social Activities
    • Committe
    • Membership
    • Lecture
  • Academic Activities
    • Teaching Experience
  • Links
    • Related Sites
    • Related Researcher
  • Profile
    • Background
    • Contact
    • Access

Intellectual Property

Empty
  •  Print 
Details
Record
22 December 2015
Last Updated: 10 November 2022

Patent

  • Motoyuki Aoi, Maiko Akatsu, Nanase Miura, Shinji Sako, "Word determination system",Japanese Patent Application No. 2018-048022, Mar. 2018.
  • Eizaburo Iwata, and Shinji Sako, "Intoxication State Determination Device and Intoxication State Determination Method", JP-A-2011-553634, WO/2012/014301, PCT/JP2010/062776, Universal Robot Co., Ltd. and Nagoya Institute of Technology, Jul. 2010.
  • Shigeki Sagayama, Takeya Saikachi, Shinji Sako, Yasuhiko Matsumoto, and Takuya Nishimoto, "Method and Device for Speech Synthesis", JP-A-2007-114355, The University of Tokyo, May. 2007.
  • Tatsuhiko Yamaguchi, Shinji Sako, Hiroshi Yamamoto, and Genichiro Kikui, "Speech Recognition Device and Computer Program", JP-A-2005-84436, Advanced Telecommunications Research Institute International (ATR), Mar. 2005.

Award and Press

Empty
  •  Print 
Details
Record
22 December 2015
Last Updated: 06 April 2020

Awards

  • 10th Mar 2016, 78th National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award
    (Naoto Sato, Shinji Sako, Tadashi Kitamura))
  • Mar. 2014, The Tokai Chapter of ASJ (Acoustical Society of Japan), Activities Award
  • 13th Mar 2014, 76th National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award
    (Kana Miyata, Shinji Sako, Tadashi Kitamura))
  • 13th Mar 2014, 76th National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award (A. Zukawa, Shinji Sako, Tadashi Kitamura))
  • Sep. 2013, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    (Ryuichi Yamamoto, Shinji Sako, Tadashi Kitamura))
  • Sep. 2013, Forum on Information Technology (FIT) Student Encouragement Award
    (Wakana Nagata, Shinji Sako, Tadashi Kitamura))
  • 19th May. 2013, Tokai Chapter of IPSJ (Information Processing Society of Japan), Student Paper Award
    (Kenta Okumura, Shinji Sako, Tadashi Kitamura)
  • 22th Jan. 2013, Tokai-Section Joint Conference on Electrical and Related Engineering, Student Encouragement Award
    (Wakana Nagata, Shinji Sako, Tadashi Kitamura) )
  • 12th Dec. 2012, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    (Ryuichi Yamamoto, Shinji Sako, Tadashi Kitamura))
  • 7th Dec. 2011, Institute of Electronics, Information and Communication Engineers (IEICE), Human Communication Group Award,
    "Improvement of HMM-based Sign Language Recognition using Phonemic Structure of Japanese Sign Language" (Shinji Sako, Koki Ariga, Tadashi Kitamura)
  • 6th Dec. 2010, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    個人性を考慮したGMMに基づいた音楽の印象推定モデル (Keiichiro Nishio, Shinji Sako, Tadashi Kitamura))
  • Mar 2010, IPSJ (Information Processing Society of Japan) Yamashita SIG Research Award
    (Satoru Fukayama, Kei Nakatsuma, Shinji Sako, Takuya Nishimoto, Shigeki Sagayama)
  • Mar 2010, National Convention of IPSJ (Information Processing Society of Japan), Student Encouragement Award
    (Rio Mizuno, Shinji Sako, Tadashi Kitamura))
  • Dec. 2009, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    "重奏用譜面を生成するための経路探索を用いたメロディのパート分配" (Rio Mizuno, Shinji Sako, Tadashi Kitamura)
  • Dec. 2009, The Tokai Chapter of ASJ (Acoustical Society of Japan), Best Presentation Award
    "Modeling and Anomaly Detection of Environmental Electromagnetic Waves Based on Patterns of Diurnal Change Using HMM" (Yuya Takase, Shinji Sako, Tadashi Kitamura))

Press

Our research results which were reported in newspaper or on TV program.

  • Yomiuri Shinbun (Newspaper), 25th Jun. 2015
    The research of synthetic speech of deceased has been introduced by major newspaper. (in Japanese)
  • WIRED UK, Sep. 2013 –Rencon: a 'Turing Test for musical expression' by Olivia Solon
    The research of artistic performance rendering and the result of RENCON 2013 has been introduced.
  • Chunichi Shinbun Evening Edition (Newspaper), 2nd May. 2012
    The research of synthetic speech of deceased has been introduced by local newspaper. (in Japanese)
  • Nagoya TV UP! Special Program, 31th Jul. 2012
    This TV program features various result of HMM-based speech synthesis technology. The research of synthetic speech of deceased has been introduced. The scene of wedding celebration when synthetic speech has been played was also introdued. (in Japanese)

Software Development

Empty
  •  Print 
Details
Record
22 December 2015
Last Updated: 20 March 2016

Software

  • Orpheus:  (The univeristy of Tokyo, Sagayama Laboratory)
    http://www.orpheus-music.org/v3/
  • MusicPipe: Automatic Arrangement System for Ensemble Music
    The MusicPipe is a automatic arrangement system for ensemble music. It can generate a ensemble music for an arbitrary combination of instruments.
    http://www.musicpipe.net/
  • SPTK: Speech Signal Processing Toolkit
    The Speech Signal Processing Toolkit (SPTK) is a suite of speech signal processing tools for UNIX environments, e.g., LPC analysis, PARCOR analysis, LSP analysis, PARCOR synthesis filter, LSP synthesis filter, vector quantization techniques, and other extended versions of them. This software is released under the Modified BSD license.
    http://sp-tk.sourceforge.net/
  • HTS: HMM-based Speech Synthesis System
    The HMM-based Speech Synthesis System (HTS) has been developed by the HTS working group and others. The training part of HTS has been implemented as a modified version of HTK and released as a form of patch code to HTK. The patch code is released under a free software license. However, it should be noted that once you apply the patch to HTK, you must obey the license of HTK. Related publications about the techniques and algorithms used in HTS can be found here.
    http://hts.sp.nitech.ac.jp/
  • Galatea Project ( Anthropomorphic Spoken Dialog Agent Toolkit)
    This project providing an open-source toolkit for anthropomorphic spoken dialogue agent with which one can develope a life-like animated agent that talks with the user and can be easily customized with the face, voice, and dialog grammar.
    https://osdn.jp/projects/galatea/
  • Galatea Talk: Japanese speech synthesis software
    http://galateatalk.sourceforge.jp/

Research Databases

  • M2TINIT: Japanese multi-modal speech database
    M2TINIT is japanese multi-modal database which was developped by Tokyo Institute of Technology and Nagoya Institute of Technology. This database consists of speech and movie (bottom of face) for 503 Japanese phonetically balanced sentence. This database is free-of-charge for academic purposes.
    http://m2tinit.sp.nitech.ac.jp/

 

Research Grant

Empty
  •  Print 
Details
Record
22 December 2015
Last Updated: 08 October 2021

Grant-in-Aid for Scientific Research (KAKENHI, The Ministry of Education, Culture, Sports, Science and Technology)

  • Grant-in-Aid for Young Scientists  (B), Subject No. 21700191, "A study on trainable singing voice synthesis system capable of representing personal characteristics and singing styles", Apr. 2009 – Mar 2012 (3 years), Principal Researcher
  • Grant-in-Aid for Scientific Research (C), Subject No. 22500506, Supervisor: Tadashi Kitamura, Research on sign subunit technique using statistical model for large vocabulary continuous sign language recognition", Apr. 2010 - Mar 2013 (3 years), Co-researcher (Principal Researcher: Tadashi Kitamura)
  • Grant-in-Aid for Scientific Research (C), Subject No. 25350666, "Research on sign subunit technique using statistical model for large vocabulary continuous sign language recognition", Apr. 2013 – Mar 2016 (3 years), Co-researcher (Principal Researcher: Tadashi Kitamura)
  • Grant-in-Aid for Young Scientists (B), Subject No. 26730182, "Research on automatic performance rendering and Coordinated accompaniment system", Apr. 2014 – Mar 2017 (3 years), Principal Researcher
  • Grant-in-Aid for Fostering Joint International Research, Subject No. 15KK00008, Apr. 2016 – Mar. 2018. (3 years), Principal Researcher
  • Grant-in-Aid for Scientific Resaerch (S), Subject No. 17H06114, "Research on development of multi-purpose Japanese Sign Language Database", Jul. 2017 – Mar. 2021, Co-Resaercher (Principal Researcher: Prof. Yuji Nagashima)
  • Grant-in-Aid for Challenging Exploratory Research, Subject No. 18K18698, "A Basic Study on the Production and Use of Sound Information by Tapping with a White Cane for the Visually Impaired", Jul. 2018 – Mar. 2022 (extended), Co-Researcher (Principal Researcher: Prof. Kiyohiko Nunokawa)

Competitive Research Grant

  • ASTEP: Adaptable and Seamless Technology Transfer Program through Target-Driven R&D, FS stage, Subject No. AS231Z02560A, "Study of the Kansei estimation model from music signal based on a statistical model depend on user's preference", Aug. 2011 – Mar 2012 (8 months), Principal Researcher
  • ASTEP: Adaptable and Seamless Technology Transfer Program through Target-Driven R&D, FS stage, Subject No. AS251Z01921H, Aug. 2013 – Mar 2014 (8 months), Principal Researcher
  • ASTEP: Adaptable and Seamless Technology Transfer Program through Target-Driven R&D, FS stage, Subject No. AS262Z00622H , Jan. 2015 – Dec. 2015, Principal Researcher

Scholarship

  • The Hori Information Science Promotion Foundation, 18th Research Grant, "Research on Automatic Arrangement Method for Ensemble Music", Apr. 2009 – Mar 2010 (1 year), Principal Researcher
  • Tatematsu Foundation, Special Research Grant, "Subunit modeling for sign and development of sign movie database", Aug. 2009 – Jul. 2010 (1 year), Principal Researcher.
  • The MIKIYA Science And Technology Foundation, Research Grant, "Research on contextual subunit modeling using large scale sign corpus", Apr. 2010 – Mar 2011 (1 year), Principal Researcher
  • Ichihara International Scholarship Fundation, Research Grant, "Research on collaborative performance system by using acoustic signals", Apr. 2012 – Mar 2012 (1 year), Principal Researcher
  • The Telecommunications Advancement Foundation (TAF), Research Grant, "HMM-based chord recognition and music genre classification techinique from auditory signal", Apr. 2010 – Mar 2011 (1 year), Principal Researcher
  • Sound Technology Promotion Foundation, Research Grant, "Music Pipe: Research on automatic arrangement method for ensemble music and development of automatic arrangement system", Apr. 2010 – Mar 2011 (1 year), Principal Researcher
  • Artificial Intelligence Research Promotion Foundation, Research Grant, "Research on automatic speech synthesis of deceased", Apr. 2013 – Mar 2014 (1 year), Principal Researcher
  • The Telecommunications Advancement Foundation (TAF), Research Grant, "Research on audio-based score alignment using statistical model", Apr. 2014 – Mar 2015 (1 year), Principal Researcher
  • Research Foundation for the Electrotechnology of Chubu (REFEC), Research Grant, "Research on automatic accompaniment system", Apr. 2015 – Mar 2016 (1 year), Principal Researcher
  • Kawai Foundation for Sound Technology & Music, 32th Research Grant for Sound Technology Promotion, "Research on automatic violin estimation", Apr. 2015 – Mar 2016 (1 year), Principal Researcher
  • Toukai Foundation for Technology (TFT), 27th Research Grant, "Research on manual-markers and non-manual markers of sign using depth sensor", Apr. 2015 – Mar 2016 (1 year), Principal Researcher
  • Hori Science & Arts Foundation, 25th Research Grant for Computer Science, "Automatic violin fingering estimation", Apr. 2016 – Mar 2017 (1 year), Principal Researcher
  • Kayamori Foundation of Informational Science Advancement , 2019 Research Grant, "A study on a sign language recognition using a first-person view with a full-surrounding camera", Jan. 2020 – Mar. 2022, Principal Researcher

Other Grant

  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "A research on statistical modeling method for characteristics of performer", Apr. 2010 – Mar. 2011 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on performance generation method based on musical interpretation", Apr. 2011 – Mar. 2012 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on collaborative performance system based on musical expression", Apr. 2012 – Mar. 2013 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on automatic fingering estimation for violin", Apr. 2013 – Mar. 2014 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Young Researcher, "Research on music performance rendering", Apr. 2014 – Mar. 2015 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Exploratory Research , "Research on sign language recognition using non-manual signal", Apr. 2015 – Mar. 2016 (1 year), Principal Researcher
  • Nagoya Institute of Technology, Research Promotion Grant for Exploratory Research, "A research on  motion tracking  using first-person video for sign language recognition", Apr.2021 – Mar. 2022 (1 year), Principal Researcher

Joint Research

  • Aug. 2007 – Mar 2008, Universal Robot co, ltd., Principal Researcher
  • Oct. 2009 – Jun. 2010, Universal Robot co, ltd., Principal Researcher
  • Sep. 2011 – Aug. 2012, Takeda Design and Manufacturing Co.,Ltd, Principal Researcher
  • Sep. 2014 – Mar 2015, Universal Robot co, ltd., Principal Researcher
  • May 2015 – Apr. 2016, Union Software Management, Co-researcher (Principal Researcher: Tadashi Kitamura)

Travel Grant

  • Nagoya Institute of Technology, International Training Program, 25th Jul. 2012 – 31th Dec. 2012 (6 months), Technische Universität München (TUM) , Munich, Germany. Visiting Researcher
  • Nagoya Institute of Technology, Oversea visit program for university-industry cooperation, 9th Dec. 2011 – 15th Dec. 2011, ACM SIGGRAPH ASIA 2011, Universal Robot HongKong, etc (HongKong), Visiting Researchter
  • Daiko Fundation, Overseas travel grant for academic exchange, 25th Oct. 2011 - 28th Oct. 2011, 12th Conference of the International Society for Music Information Retrieval (ISMIR) (Florida, USA), Presenter
  • Tatematsu Foundation, Overseas travel grant for academic exchange, 20th Jul. 2013 – 28th Jul. 2013, 15th International Conference on Human-Computer Interaction (LasVegas, USA), Presenter
  • The Telecommunications Advancement Foundation (TAF), Overseas travel grant for academic exchange, 11th Aug. 2014 – 15th Aug. 2014, 2014 International Conference on Active Media Technology (AMT) (Warsaw, Poland), Presenter
  • Nagoya Institute of Technology, International promotion project 2014, 29th Aug. 2015 – 24th Sep. 2015, AGH University of Science and Technology (Krakow, Poland), Technische Universität München (Munich, Germany), Project Manager
  • Nagoya Institute of Technology, Oversea visit program for university-industry cooperation, 8th Sep. 2015 – 9th Sep. 2015, VoicePIN (Krakow, Poland), Visiting Researcher
  • Nagoya Institute of Technology, International promotion project 2014, 23th Aug. 2016 – 23th Nov. 2016 (3 months), AGH University of Science and Technology (Krakow, Poland), Project Manager
Bootstrap is a front-end framework of Twitter, Inc. Code licensed under MIT License. Font Awesome font licensed under SIL OFL 1.1.