Publicação
Unification of Closed-Open Industrial Detection Scenarios
| dc.contributor.author | Zhang, Zekai | |
| dc.contributor.author | Zhang, Jinglin | |
| dc.contributor.author | Chen, Qinghui | |
| dc.contributor.author | Li, Gang | |
| dc.contributor.author | Chen, Da | |
| dc.contributor.author | Jing, Shuainan | |
| dc.contributor.author | Wang, He | |
| dc.contributor.author | Li, Dagang | |
| dc.contributor.author | Liu, Cong | |
| dc.contributor.author | Bai, Cong | |
| dc.contributor.author | Chen, Shengyong | |
| dc.contributor.institution | NOVA Information Management School (NOVA IMS) | |
| dc.contributor.institution | Information Management Research Center (MagIC) - NOVA Information Management School | |
| dc.contributor.pbl | IEEE Computer Society | |
| dc.date.accessioned | 2026-07-13T10:51:02Z | |
| dc.date.available | 2026-07-13T10:51:02Z | |
| dc.date.embargoedUntil | 2028-04-03 | |
| dc.date.issued | 2026-08 | |
| dc.description | Zhang, Z., Zhang, J., Chen, Q., Li, G., Chen, D., Jing, S., Wang, H., Li, D., Liu, C., Bai, C., & Chen, S. (2026). Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks, Challenges and Baselines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(48), 9571-9588. https://doi.org/10.1109/TPAMI.2026.3680569 | |
| dc.description.abstract | Large-scale Visual-Language Models (LVLMs) have achieved remarkable success in natural visual tasks, yet their application to industrial defect detection remains challenging due to two fundamental limitations: (i) the scarcity of large-scale industrial datasets that cover diverse defect categories across multiple domains, and (ii) the reliance on manual prompts (points, boxes, masks) that introduce subjective noise and lack text-visual interaction for fine-grained understanding. To address these challenges, we introduce a Large-Scale Multi-Modal Industrial Open-Closed benchmark (MMIOC-1M) containing over one million samples across 14 super-categories, 29 industrial scenes, and 351 defect subcategories. To our knowledge, MMIOC-1M is the first unified largest benchmark supporting both open-vocabulary and closed-set industrial detection, providing valuable pre-training data for LVLMs in industrial scenarios. Furthermore, we propose a Refined Text-Visual Prompt Network (RTVPNet) that incorporates three key innovations: (1) an expert-assisted domain projection mechanism that enables rapid adaptation of general vision models to industrial domains, (2) an energy-based sparse sampling strategy that automatically generates refined visual prompts without manual intervention, and (3) a bidirectional text-visual interaction module that enhances cross-modal semantic alignment and understanding. Extensive experiments demonstrate that RTVPNet achieves state-of-the-art performance on MMIOC-1M, LVIS, and COCO benchmarks while maintaining computational efficiency. The dataset and code are available at https://github.com/hellozzk/MMIO. | en |
| dc.description.version | authorsversion | |
| dc.description.version | published | |
| dc.format.extent | 18 | |
| dc.format.extent | 20443674 | |
| dc.identifier.doi | 10.1109/TPAMI.2026.3680569 | |
| dc.identifier.issn | 0162-8828 | |
| dc.identifier.other | PURE: 159075177 | |
| dc.identifier.other | PURE UUID: 4624640f-6ca4-4cbb-addd-218f4633ba6d | |
| dc.identifier.other | Scopus: 105034860840 | |
| dc.identifier.other | WOS: 001815311000033 | |
| dc.identifier.uri | http://hdl.handle.net/10362/204450 | |
| dc.identifier.url | https://www.scopus.com/pages/publications/105034860840 | |
| dc.identifier.url | https://www.webofscience.com/wos/woscc/full-record/WOS:001815311000033 | |
| dc.language.iso | eng | |
| dc.peerreviewed | yes | |
| dc.relation | https://doi.org/10.54499/UID/04152/2025 | |
| dc.relation | https://doi.org/10.54499/UID/PRR/04152/2025 | |
| dc.subject | Industrial Open Detection | |
| dc.subject | Large Scale Industrial Benchmark | |
| dc.subject | Visual Language Model | |
| dc.subject | Software | |
| dc.subject | Computer Vision and Pattern Recognition | |
| dc.subject | Computational Theory and Mathematics | |
| dc.subject | Applied Mathematics | |
| dc.subject | Artificial Intelligence | |
| dc.subject | SDG 9 - Industry, Innovation, and Infrastructure | |
| dc.title | Unification of Closed-Open Industrial Detection Scenarios | en |
| dc.title.subtitle | New Large-Scale Benchmarks, Challenges and Baselines | en |
| dc.type | journal article | |
| degois.publication.firstPage | 9571 | |
| degois.publication.issue | 48 | |
| degois.publication.lastPage | 9588 | |
| degois.publication.title | IEEE Transactions on Pattern Analysis and Machine Intelligence | |
| degois.publication.volume | 8 | |
| dspace.entity.type | Publication | |
| rcaap.rights | embargoedAccess |
Ficheiros
Principais
1 - 1 de 1
Miniatura indisponível
- Nome:
- Unification_of_Closed-Open_AAM.pdf
- Tamanho:
- 19.5 MB
- Formato:
- Adobe Portable Document Format
