Profile photo

News

Contact

shitanda[at]mi.t.u-tokyo.ac.jp

Hi! I am a Ph.D. student in the Graduate School of Information Science and Technology at The University of Tokyo. I am affiliated with the Machine Intelligence Lab and the RIKEN AIP Robot Learning Team, and am supervised by Prof. Tatsuya Harada and Dr. Takayuki Osa.

I am particularly interested in scalable reinforcement learning algorithms for large-scale parallel environments and in dexterous manipulation. Related work was accepted to ICLR 2026.

In summer 2025, I had a great opportunity to work on a dexterous manipulation project Soft Robotics Lab at ETH Zurich. I received my M.S. from The University of Tokyo and my B.Eng. from Kyoto University. Since 2021, I have also been working as a Research Assistant at Sony CSL - Kyoto under Prof. Jun Rekimoto.

πŸŽ‰ Latest Paper πŸŽ‰

Rethinking Policy Diversity in Ensemble Policy Gradient in Large-Scale Reinforcement Learning

Paper image

ICLR 2026 @ Rio de Janeiro (Poster)

April 2026

We study multi-policy reinforcement learning in large-scale parallel environments and show how policy diversity affects learning. By appropriately controlling diversity within policy sets, our method achieves high sample efficiency and strong final performance on object manipulation tasks.

Education

  • 2026.04 - Present: Ph.D. Program, Department of Mechano-Informatics, Graduate School of Information Science and Technology, The University of Tokyo Supervisor: Prof. Tatsuya Harada
  • 2024.04 - 2026.03: Master of Information Science and Technology, Department of Mechano-Informatics, Graduate School of Information Science and Technology, The University of Tokyo Supervisors: Prof. Tatsuya Harada, Assoc. Prof. Takayuki Osa
  • 2019.04 - 2024.03: B.E., Department of Electrical and Electronic Engineering, Kyoto University Supervisor: Prof. Toshiya Doi

Study Abroad

  • 2024.07 - 2026.09: ETH Zurich ETH Robotics Summer Fellowship 2025, Prof. Robert Katzschmann, acceptance rate: 3.1%
  • 2022.09 - 2023.06: University of Bristol / Bristol Robotics Laboratory Exchange student & visiting researcher, Prof. Jonathan Rossiter

Internships

  • 2025.11 - Present: RIKEN Center for Advanced Intelligence Project (AIP)
    Robot Learning Team (Takayuki Osa)
  • 2021.02 - Present: Sony Computer Science Laboratories, Inc.
    Research assistant under Deputy Director Jun Rekimoto (Kyoto): (1) data collection support systems for 3D reconstruction (2025-), (2) in-the-wild 3D reconstruction (2023-2024), (3) interactive architectural elements with variable transparency (2022-2023)
  • 2024.07 - 2025.11: FingerVision Inc. Contract development of a computer vision system for automatic dish identification and dishwashing robots
  • 2024.05 - 2024.06: Preferred Networks, Inc.
    Part-time engineer (robot learning)
  • 2019.10 - 2021.09: Muscle Corporation
    Part-time engineer; developed a low-cost mannequin robot for fashion displays. Adopted in the "Hiroko Koshino Exhibition" at Hyogo Prefectural Museum of Art from April 2022.

Other

  • 2025.06 - 2026.03: MITOU Program for Innovative IT Human Resources (FY2025)
    Project: development platform for modular social robots for self-expression, with Sotaro Yokoi, Naoki Shitanda, and Kento Matsuo. Acceptance rate: 9.3%. Certified as an IPA MITOU Super Creator.

Awards

  • 2026.06: IPA MITOU Super Creator [Link] A distinction awarded by Japan's government-affiliated Information-technology Promotion Agency (IPA) to outstanding software innovators.
  • 2025.10: Maker Faire Tokyo Young Maker Challenge Sponsor Award (SLB Award) [Link]
  • 2024.03: Completed the Kyoto University International Education Program
  • 2022.11: Techno-Ai 2022 Encouragement Award and Fighting Spirit Award (University Division) [Link]
  • 2021.11: Techno-Ai 2021 Excellence Award and Encouragement Award (University Division) [Link]

Media

  • 2026-06-10: RIKEN Develops Highly Efficient Reinforcement Learning Technology for Sim-to-Real, Effective on Hard Problems Existing Methods Cannot Solve [Link]Nikkei Robotics, July 2026 issue. Japanese article; title translated.

Research Funding

  • GCL FY2025 Independent Research and Activity Grant, Category B FY2025, JPY 500,000

Scholarships

  • BOOST NAIS: Next-generation AI for Intelligent Society FY2026-FY2028, Fellowship + Research Funding(500,000 JPY/year)
  • Teijin Scholarship Foundation FY2026-FY2028
  • Tobitate! Study Abroad Initiative: Japan Representative Program FY2026

  • WINGS-IIW, The University of Tokyo (International Graduate Program for Intelligent Society) 2024 April ~ 2026 March (2029 March), Fellowship
  • Hayashi Rheology Memorial Foundation 2024 April ~ 2026 March (Completed)
  • Okuyama Scholarship Foundation 2022 September ~ 2024 March (Completed)
  • Leave a Nest Scholarship, Osaka Seminar FY2023 (Completed)
  • JASSO Overseas Study Support Program (Exchange Dispatch) 2022 September ~ 2023 May
  • Kyoto University International Education Program 2022 ~ 2024 (Completed)
  • Kyoto University Study Abroad Grant 2022 (Declined / Returned)
  • Okura Mutual Aid Association: Support for Students Studying Abroad 2022 (Completed)
  • KEYENCE Foundation "Go for it! Japanese University Students" Support Grant 2022 (Completed)