Self-Improving Agents · Multimodal AI · Computer Vision

Beomyoung Kim 김범영

Research Scientist, NAVER Cloud (Image Vision)

I'm a Research Scientist at NAVER Cloud and a Ph.D. student at KAIST. My current research focuses on self-improving agents — agents for agents that analyze execution trajectories, identify limitations, and iteratively improve agent systems with frozen model weights. I currently focus on visual agents, with the goal of developing methods that generalize across agent systems.

My background spans visual recognition — segmentation, detection, and matting — and grounded VLMs and visual reasoning agents, with 14+ papers at CVPR, ICCV, ECCV, NeurIPS, and AAAI (608 citations, h-index 10). I bring that experience in perception and diagnostic reasoning, along with a track record of taking research into products used by millions, to my current work on agents that improve through experience.

Email· DBLP· LinkedIn· 📍 Seoul, Korea
Beomyoung Kim
14+
Publications
608
Citations
10
h-index
5+
Years @ NAVER
Research

What I work on

Self-Improving Agents NOW @ NAVER

Agents for Agents

Developing meta-agents that analyze execution trajectories, identify where an agent falls short, propose and apply targeted changes, and re-evaluate its behavior. This improvement loop refines the agent harness — its prompts and instructions, workflows and tool use, code and architecture, and memory and skills — while keeping all model weights frozen.

Currently focused on visual agents, with the goal of developing improvement methods that generalize across agent systems.

Earlier Research

VLMs & Visual Reasoning Agents

Studied grounded VLMs that connect language to pixel- and region-level evidence, and visual reasoning agents that compose specialist vision models into executable workflows.

Failure diagnosis & targeted program repair

Vision Foundation Models & Matting

Promptable, zero-shot segmentation & matting for anything; label-efficient human matting.

ZIM (ICCV'25 Highlight) · WSSHM

Label-Efficient Segmentation

Weakly- and semi-supervised semantic & instance segmentation from cheap supervision.

PointWSSIS · BESTIE · DRS · WSSS-BED

Continual & Efficient Learning

Class-incremental and panoptic continual segmentation; lightweight, efficient models.

ECLIPSE · SSUL · EResFD · PfLayer

Updates

News

Jun 2026🔥 Phoenix accepted to ECCV 2026.
Jun 2025🔥 ZIM accepted to ICCV 2025 as a Highlight.
Oct 2024🎤 Invited talk at TEAM NAVER DAN 24 — CLOVA-X image editing.
Mar 2024🔥 ECLIPSE accepted to CVPR 2024.
Feb 2023🔥 PointWSSIS accepted to CVPR 2023.
Peer-reviewed · 14+ papers

Selected Publications

Under review
Under review · ICLR 2027 · Visual Reasoning Agents

Visual reasoning agents. A diagnostic framework for 3D spatial reasoning that turns silent perception failures in visual program synthesis into typed diagnoses, driving targeted program repair to rival frontier VLMs without task-specific training.

2026
NeurIPS 2026

Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images

Junhee Lee, JeonDongHyeon, Taeoh Kim, Beomyoung Kim, MyeongAh Cho
arXiv · code coming soon
ECCV 2026

Learning from Adversity: Semantic-Aware Mask Refinement through Adversarial Perturbation

Beomyoung Kim, Sung Ju Hwang
2025
ICCV 2025 · ★ Highlight

ZIM: Zero-Shot Image Matting for Anything

Beomyoung Kim, Chanyong Shin, Joonhyun Jeong, Hyungsik Jung, Se-Yun Lee, Sewhan Chun, Dong-Hyun Hwang, Joonsang Yu
projectarXivcode
bibtex
@inproceedings{kim2025zim,
  title={ZIM: Zero-Shot Image Matting for Anything},
  author={Kim, Beomyoung and others},
  booktitle={ICCV}, year={2025}}
2024
arXiv preprint

Towards Label-Efficient Human Matting

Beomyoung Kim, Myeong Yeon Yi, Joonsang Yu, Young Joon Yoo, Sung Ju Hwang
arXiv preprint

Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation

Beomyoung Kim, Donghyeon Kim, Sung Ju Hwang
CVPR 2024

ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning

Beomyoung Kim, Joonsang Yu, Sung Ju Hwang
WACV 2024

EResFD: Rediscovery of the Effectiveness of Standard Convolution for Lightweight Face Detection

Joonhyun Jeong, Beomyoung Kim, Joonsang Yu, Youngjoon Yoo
2023
CVPR 2023

The Devil is in the Points: Weakly Semi-Supervised Instance Segmentation via Point-Guided Mask Representation

Beomyoung Kim, Joonhyun Jeong, Dongyoon Han, Sung Ju Hwang
2022
CVPR 2022

Beyond Semantic to Instance Segmentation via Semantic Knowledge Transfer and Self-Refinement

Beomyoung Kim, Youngjoon Yoo, Chaeeun Rhee, Junmo Kim
ICLR 2022

Learning Features with Parameter-Free Layers

Dongyoon Han, Youngjoon Yoo, Beomyoung Kim, Byeongho Heo
WACV 2022

TricubeNet: 2D Kernel-Based Object Representation for Weakly-Occluded Oriented Object Detection

Beomyoung Kim, Janghyeon Lee, Sihaeng Lee, Doyeon Kim, Junmo Kim
2021 & earlier
NeurIPS 2021

SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning

Sungmin Cha*, Beomyoung Kim*, Youngjoon Yoo, Taesup Moon (* equal)
AAAI 2021

Discriminative Region Suppression for Weakly-Supervised Semantic Segmentation

Beomyoung Kim, Sangeun Han, Junmo Kim
MIWAI 2021

3D Point Cloud Upsampling and Colorization using GAN

Beomyoung Kim, Sangeun Han, Eojindl Yi, Junmo Kim
RiTA 2020

Fully Automated Valet Parking System Based on Infrastructure Sensing

Hyunjee Ryu, Beomyoung Kim, Heecheol Yoo, Jungwon Lee
Research → Product

Real-World Impact

Background

Experience & Education

Experience
NAVER Cloud · Image Vision
Research Scientist · self-improving agents
formerly NAVER CLOVA
2021 — now
Research Internships
NAVER CLOVA (FACE, OCR) · Hyundai Mobis (Autonomous Driving)
2018 — 2020
Education
KAIST · Graduate School of AI
Ph.D. — MLAI Lab, Prof. Sung Ju Hwang
2022 — now
KAIST · Electrical Engineering
M.S. — SIIT Lab, Prof. Junmo Kim
2019 — 2021
Inha University
B.S. — Information & Comm. Engineering
2013 — 2019
Academic Service

Conference & Journal Reviewer

2026CVPR · ECCV · NeurIPS · ICLR · TPAMI
2025CVPR · ICCV · NeurIPS · ICLR · TMLR
2024CVPR · ECCV · NeurIPS · ICLR · AAAI
2023CVPR · ICCV · NeurIPS · WACV
Outreach

Invited Talks

Centum Digital Week 2025
2025

Centum Digital Week — Next Code 2025

"Beyond AI, Into Agents." A researcher's story from the AI agent era.

event →
TEAM NAVER DAN 24
2024

TEAM NAVER Conference DAN 24

CLOVA-X Image Editing: the world of pixel magic delivered by AI.

session →
Catch Career-Con 2022
2022

Jinhaksa Catch Career-Con

How to land an AI research engineer role — career mentoring (NAVER CLOVA).

NeurIPS 2021 ML in Korea
2021

NeurIPS 2021 Social — ML in Korea

SSUL: Semantic Segmentation with Unknown Label for Class-Incremental Learning.

social →
Inha University
2022

Inha University — Invited Lecture

Weakly-Supervised Instance Segmentation (CVPR 2022), hosted by Prof. Chaeeun Rhee.