• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on large-scale creative work by cooperation in crowdsourcing

Research Project

Project/Area Number 19H04218
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 62020:Web informatics and service informatics-related
Research InstitutionGifu University

Principal Investigator

Suzuki Yu  岐阜大学, 工学部, 准教授 (40388111)

Co-Investigator(Kenkyū-buntansha) 灘本 明代  甲南大学, 知能情報学部, 教授 (30359103)
波多野 賢治  同志社大学, 文化情報学部, 教授 (80314532)
Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000)
Fiscal Year 2022: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2021: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2020: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2019: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Keywordsクラウドソーシング / 機械学習 / データ品質 / マルチタスク学習 / 協調作業 / Webサービス / 情報の品質 / CSCW / 作業者 / Webアプリケーション / RDBMS / Web / 品質 / データベース / Twitter / NoSQL
Outline of Research at the Start

本研究ではクラウドソーシングにおいて創造的な作業を大規模に行う際など,協調的作業において高品質な作業結果を得るための作業環境を構築することを目的とする.この作業環境は,制作物の正解を事前に定めることができない状況で利用可能である点,低品質な作業者を再教育する点が特徴である.例えば,短編創作小説を多人数の作業者で協調して作成することを考える.このとき,まず作業者の客観的および主観的な特徴を機械学習アルゴリズムに入力し,作業者の品質を推定する.また,この結果から他の作業者により作業結果の品質を向上させる方法を示す.

Outline of Final Research Achievements

Using crowdsourcing, a working platform by unspecified workers over the Internet, we construct a method for developing creative sentences. In our research, we mainly focus on two research topics; 1) how to measure the quality of outputs, and 2) how to aggregate multiple outputs for improving quality of outputs. To solve 1), we extract features from outputs and construct machine learning models. To solve 2), we use multi-task learning method. We developed Web applications to accomplish these tasks. We evaluate our system to confirm the effectiveness of our proposed method.

Academic Significance and Societal Importance of the Research Achievements

本研究における成果によって,高い品質のデータを大量に作成するための方法を構築することができた.また,マルチタスク学習に必要なデータセットの構築を機械学習と人手の組み合わせにより高品質で作成することができた.複数の作業者により一つのタスクを行う場合の合意形成過程について明らかとなったため,高い精度で機械学習による分類や予測を行うために必要な方法が明らかになった.実際に企業において提案Webシステムを用いたため,実用的な精度であることも明らかになった.

Report

(5 results)
  • 2023 Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (27 results)

All 2024 2023 2021 2020 2019

All Journal Article (3 results) (of which Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (24 results) (of which Int'l Joint Research: 14 results)

  • [Journal Article] Automatic Stopword Generation Based on Attention for Document Classification Using Neural Networks2024

    • Author(s)
      Yuki Kuwabara, Yu Suzuki
    • Journal Title

      Journal of Information Processing

      Volume: 32 Issue: 0 Pages: 487-495

    • DOI

      10.2197/ipsjjip.32.487

    • ISSN
      1882-6652
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 部分構造を考慮した化合物分散表現の食材分類タスクにおける効果2024

    • Author(s)
      吉丸 直希, 木村 優介, 楠 和馬, 波多野 賢治
    • Journal Title

      日本データベース学会和文論文誌

      Volume: 22-J Pages: 2-2

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An Automatic Labeling Method for Subword-Phrase Recognition in Effective Text Classification2023

    • Author(s)
      Kimura Yusuke、Komamizu Takahiro、Hatano Kenji
    • Journal Title

      Informatica

      Volume: 47 Issue: 3

    • DOI

      10.31449/inf.v47i3.4742

    • Related Report
      2022 Annual Research Report
  • [Presentation] 機械学習とクラウドソーシングを用いた顧客の声の自動分類2024

    • Author(s)
      鈴木 優,城所 祥太,北村 拓斗,太田 奈那,三島 惇也,本田 文隆,長徳 弘一,中村 勇太,佐々木 和彦,笠丸 陽一
    • Organizer
      第16回データ工学と情報マネジメントに関するフォーラム (DEIM2024)
    • Related Report
      2022 Annual Research Report
  • [Presentation] List-wise手法における順位に基づいた多段階分割と学習データの上位遷移による能動学習2024

    • Author(s)
      エルゲン 瑛夏,鈴木 優
    • Organizer
      データ工学と情報マネジメントに関するフォーラム (DEIM2024)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 動画の属するコミュニティ情報を考慮した動画再生回数予測手法の提案2024

    • Author(s)
      川上 大凱,鈴木 優
    • Organizer
      データ工学と情報マネジメントに関するフォーラム (DEIM2024)
    • Related Report
      2022 Annual Research Report
  • [Presentation] クラウドワーカの作業結果と投票結果から生成される確率分布を利用した結果集約手法2024

    • Author(s)
      城所 祥太,鈴木 優
    • Organizer
      データ工学と情報マネジメントに関するフォーラム (DEIM2024)
    • Related Report
      2022 Annual Research Report
  • [Presentation] ユーザの性格タイプの差異に基づく災害時行動促進情報理解の分析2024

    • Author(s)
      若杉 広介,鈴木 優,灘本 明代
    • Organizer
      データ工学と情報マネジメントに関するフォーラム (DEIM2024)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 誹謗中傷検出タスクの学習を補助するためのサブタスクの提案2024

    • Author(s)
      沢田 凌一,鈴木 優
    • Organizer
      データ工学と情報マネジメントに関するフォーラム (DEIM2024)
    • Related Report
      2022 Annual Research Report
  • [Presentation] Feature Analysis of Regional Behavioral Facilitation Information Based on Source Location and Target People in Disaster2023

    • Author(s)
      Kosuke Wakasugi, Futo Yamamoto, Yu Suzuki, Akiyo Nadamoto
    • Organizer
      International Conference on Big Data Analytics and Knowledge Discovery
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Label Aggregation Method Using Worker Quality in Crowdsourcing2023

    • Author(s)
      Nana Ota, Yu Suzuki
    • Organizer
      International Conference on Information Integration and Web Intelligence
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Attention Based Stopword Generation for Neural Network Based Text Processing2023

    • Author(s)
      Yuki Kuwabara, Yu Suzuki
    • Organizer
      International Conference on Information Integration and Web Intelligence
    • Related Report
      2022 Annual Research Report
  • [Presentation] クラウドソーシングにおけるラベル付け難易度を考慮したタスク割当手法2023

    • Author(s)
      城所 祥太,鈴木 優
    • Organizer
      電子情報通信学会データ工学研究会研究報告
    • Related Report
      2022 Annual Research Report
  • [Presentation] Measuring Quality of Workers by Goodness-of-Fit of Machine Learning Model in Crowdsourcing2021

    • Author(s)
      Yu Suzuki
    • Organizer
      International Database Engineering & Applications Symposium(IDEAS2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Autonomous Crowdsourcing System2021

    • Author(s)
      Yu Suzuki
    • Organizer
      International Conference on Database and Expert Systems Applications (DEXA2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Analysis of Behavioral Facilitation Tweets for Large-Scale Natural Disasters Dataset using Machine Learning2021

    • Author(s)
      Yu Suzuki, Yoshiki Yoneda, Akiyo Nadamoto
    • Organizer
      International Conference on Database and Expert Systems Applications (DEXA2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Fact-checking Assistant System for Textual Documents2021

    • Author(s)
      Tomoya Furuta, Yu suzuki
    • Organizer
      IEEE International Conference on Multimedia Information Processing and Retrieval (IEEE MIPR 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Comparison of Deep Learning Models for Automatic Generation of Product Description on E-commerce site2021

    • Author(s)
      Kenji Fukumoto, Rinji Suzuki, Hiroyuki Terada, Masafumi Bato and Akiyo Nadamoto
    • Organizer
      International Conference on Information Integration and Web Intelligence (iiWAS2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Extraction and Analysis of Regionally Specific Behavioral Facilitation Information in the Event of a Large-scale Disaster2021

    • Author(s)
      Futo Yamamoto, Yu Suzuki and Akiyo Nadamoto
    • Organizer
      IEEE/WIC/ACM International Conference on Web Intelligence (WI-IAT ’21)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Fact-checking Assistant System for Textual Documents2021

    • Author(s)
      Tomoya Furuta, Yu suzuki
    • Organizer
      International Conference on Multimedia Information Processing and Retrieval
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automatic Terminology Extraction using A Dependency-Graph in NLP2020

    • Author(s)
      Yusuke Kimura, Kazuma Kusu, Kenji Hatano, Tokiya Baba
    • Organizer
      Proceedings of the 9th World Congress on Information and Communication Technologies,
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Resampling Method for Imbalanced Datasets Considering Noise and Overlap2020

    • Author(s)
      Taisho Sasada, Zhaoyu Liu, Tokiya Baba, Kenji Hatano, Yusuke Kimura
    • Organizer
      Procedia Computer Science
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Extracting Rhetorical Question from Twitter2020

    • Author(s)
      Rinji Suzuki, Akiyo Nadamoto
    • Organizer
      Proceedings of The 22nd International Conference on Information Integration and Web-based Applications & Services (iiWAS2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] データの複雑性を考慮した不均衡データに対するリサンプリング手法2020

    • Author(s)
      笹田 大翔, 馬場 睦也, 木村 優介, 波多野 賢治
    • Organizer
      情報処理学会第 82 回全国大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Behavioral Facilitation Tweets with Basis Extraction2019

    • Author(s)
      Yoshiki Yoneda, Yu Suzuki, and Akiyo Nadamoto
    • Organizer
      IEEE International Conference on Data Mining Workshops
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Detection of Behavioral Facilitation information in Disaster Situation2019

    • Author(s)
      Yoshiki Yoneda, Yu Suzuki, and Akiyo Nadamoto
    • Organizer
      International Conference on Information Integration and Web-based Applications & Services
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 機械学習を用いた災害時行動促進情報抽出手法の比較検討2019

    • Author(s)
      米田吉希, 見塚圭一, 鈴木優, 灘本明代
    • Organizer
      Webとデータベースに関するフォーラム
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi