易盾服务启动手册

外观

antispam-business-audio — 点播语音内容安全 ​

分层：业务层 ｜ 部署单元：7 个（k8s 实部署 6 个） ｜ 数据库：PostgreSQL（库 antispam） ｜ base image：private-registry.nis.netease.com/library/base-image:jdk17（tag base-250409）

一、模块定位与架构 ​

模块是易盾「点播语音」内容安全产品的服务端：客户提交语音 URL/base64 后，它完成涉黄、涉政、涉暴、广告、语种、声纹等异步或同步反垃圾检测，输出结论回调、主动查询、存档归档与计量计费，承载点播语音反垃圾从提交到计费的权威判定与数据留存。

架构分层

  • 协议层：facade/http-check-api（异步提交 /vX/audio/submit、同步检测 /v1/audio/sync、检测回调 /v1/audio/check）、facade/http-api（结果回调/查询/反馈/片段播放）、facade/dubbo-provider + facade/dubbo-check-provider（Dubbo 服务）
  • 逻辑层：storage（消费 Kafka、执行检测与结果组装）、facade/dubbo-check-provider/checker、service/business
  • 数据层：service/base（MyBatis DAO + Manager + 动态数据源）、service/business（ES/Redis/Kafka 封装）、scheduler（Elastic-Job）
  • 公共：common、domain、facade/{dubbo-api,dubbo-check-api}、console/api、file

关键数据流（异步检测）

  1. AudioSubmitController.submit → AbstractController.submitPool（Redis 限流/去重 + 缓冲池）
  2. Kafka Yidun_Antispam_NewAudioEvidence → AudioSubmitHandler.insertDb（入库，状态置 TO_BE_CHECK）
  3. Kafka Yidun_Antispam_PreAudioSubmit → AudioEvidenceCheckService.audioCheck（调用 Dubbo 检测）
  4. AudioCallbackHandler 组装结果并主动回调客户；同步计量/操作记录/ES 同步
  5. 状态机：AudioStatus（7 待检测 → 3 成功 / 4 失败）+ AudioFrontStatusEnum（0 待检测 → 1 检测中 → 2 成功 → 3 失败）

二、可部署服务清单 ​

部署单元目录artifactId镜像名端口服务类型独立 Dockerfile是否进 kubernetes.yml
facade/dubbo-providerantispam-business-audio-facade-dubbo-providerantispam-business-audio-dubbo-provider无 HTTP（Dubbo）Dubbo Provider（查询/更新）有是
facade/dubbo-check-providerantispam-business-audio-facade-dubbo-check-providerantispam-business-audio-dubbo-check-provider无 HTTP（Dubbo）Dubbo Provider（checker 链）有是
facade/http-check-apiantispam-business-audio-facade-http-check（无 -api 后缀）antispam-business-audio-http-check-api8080（private）HTTP 提交/同步检测有是
facade/http-apiantispam-business-audio-facade-http（无 -api 后缀）antispam-business-audio-http-api8080（private）HTTP 回调/查询/反馈有是
storageantispam-business-audio-storageantispam-business-audio-storage无 HTTP（Kafka 消费）Kafka 消费落库有是
schedulerantispam-business-audio-schedulerantispam-business-audio-scheduler无 HTTP（定时任务）Elastic-Job有是
console/apiantispam-business-audio-console-api——控制台后端骨架无（不构建）否

common、domain、service/base、service/business、service、facade/dubbo-api、facade/dubbo-check-api、facade、file 为非部署库模块。本项目无 async 单元、无 cdc 模块、无 console/web。

三、同模块启动顺序 ​

  1. facade/dubbo-check-provider — checker 检测链注册 ZK，是检测能力前置
  2. facade/dubbo-provider — 数据查询/更新 Dubbo 服务，内部持有 master/mirror 双数据源
  3. facade/http-check-api — 提交/同步检测入口，submitPool 依赖 Redis 缓冲池
  4. facade/http-api — 回调/查询/反馈入口，依赖同库 DAO 与 Dubbo 提供方
  5. storage — 消费 Yidun_Antispam_NewAudioEvidence/Yidun_Antispam_PreAudioSubmit，需 Kafka/Redis/DB 就绪
  6. scheduler — Elastic-Job 定时任务；依赖 ZK、DB、OSS；晚于 storage 更安全

理由：Dubbo 提供方必须先于消费方；storage 消费 http-check-api 写入的 topic，Redis 缓冲池 key（antispam-business-text-deal-* 之外的本模块 key）与 OSS 桶须先可用。

四、逐服务启动逻辑 ​

facade/http-check-api ​

  • 启动类：com.netease.is.antispam.audio.facade.http.HttpCheckApplication（facade/http-check-api/.../HttpCheckApplication.java）
  • exclude：DataSourceAutoConfiguration
  • @Enable*：@EnableBusinessClient、@EnableRateLimiter、@EnableRecoverComponent、@EnableI18nComponent、@EnableApolloConfig
  • 配置类：configuration/FacadeHttpConfiguration（同包 sub 包，被 @SpringBootApplication 默认扫描），@Configuration + @ComponentScan({"com.netease.is.antispam.audio.facade.http.controller","...audio.redis","...audio.kafka","...audio.facade.http.zookeeper","...audio.recover","...audio.component","...audio.integration","...audio.helper"})
  • main()：无自定义
  • 钩子：AudioModelCacheService @PostConstruct、RedisCommonService @PostConstruct、TEXT/Audio 限流组件（@PostConstruct）
  • Apollo：app.id=antispam-audio_http-check，namespaces=application,antispam-audiovideo_common，apollo.cache-dir=./apollo/cache，apollo.meta=http://yd-apollo-config.nistest.netease.com

facade/http-api ​

  • 启动类：com.netease.is.antispam.audio.facade.http.HttpApplication（facade/http-api/.../HttpApplication.java）
  • @SpringBootApplication（无 exclude）；@EnableOssClient、@EnableCdcDataSubscribe、@EnableBusinessClient、@EnableRateLimiter、@EnableDistributeId、@EnableRecoverComponent、@EnableI18nComponent、@PropertySources({@PropertySource("classpath:audio-oss.properties")})
  • 配置类：configuration/FacadeHttpConfiguration（@ComponentScan 同 http-check-api 的 controller/redis/kafka/…）+ @MapperScan("com.netease.is.antispam.audio.dao")
  • main()：无自定义；Apollo：app.id=antispam-audio_http

facade/dubbo-provider ​

  • 启动类：com.netease.is.antispam.business.audio.facade.dubbo.DubboApplication
  • exclude：DataSourceAutoConfiguration
  • @EnableAspectJAutoProxy、@EnableFacadeAutoConfiguration（→FacadeConfiguration：@ComponentScan({"…audio.service","…audio.manager",…}) + @MapperScan）、@EnableCdcDataSubscribe、@EnableOssClient、@PropertySources({audio-oss.properties})、@EnableBusinessClient、@EnableDistributeId、@EnableRecoverComponent
  • 数据源：spring.datasource.master.* / spring.datasource.mirror.*（动态数据源）
  • main()：无自定义；Apollo：app.id=antispam-audio_dubbo

facade/dubbo-check-provider ​

  • 启动类：com.netease.is.antispam.business.audio.facade.check.dubbo.DubboCheckApplication
  • exclude：DataSourceAutoConfiguration；@EnableAspectJAutoProxy、@EnableFacadeAutoConfiguration（→FacadeConfiguration：@ComponentScan({"…facade.check.dubbo.checker.service","…facade.check.dubbo.provider","…facade.check.dubbo.zookeeper","…audio.component","…audio.kafka","…audio.redis","…audio.recover"})）、@EnableConfigurationProperties({CheckerConfig.class})、@EnableBusinessClient、@EnableRecoverComponent、@EnableApolloConfig
  • main()：无自定义；钩子：YidunKafkaNoDelayProducer @PostConstruct
  • Apollo：app.id=antispam-audio_dubbo-check

storage ​

  • 启动类：com.netease.is.antispam.audio.storage.StorageApplication
  • @SpringBootApplication；@EnableStorageAutoConfiguration（→StorageConfiguration：@ComponentScan({"…audio.storage.consumer","…audio.manager","…audio.component","…audio.storage.zookeeper","…audio.kafka","…audio.service","…audio.recover","…components.callback","…audio.redis","…audio.storage.recover","…audio.integration","…audio.es"}) + @MapperScan("…audio.dao")）、@EnableCdcDataSubscribe、@EnableBusinessClient、@EnableRateLimiter、@EnableDistributeId、@EnableRecoverComponent、@EnableOssClient、@PropertySources({audio-oss.properties})、@EnableApolloConfig
  • Kafka：平台自研 @KafkaConsumer；topic 常量见 common/.../constant/AudioKafkaTopic.java
  • main()：无自定义；钩子：YidunQosApplication（doOffline() pause Kafka 容器并 sleep）、AudioEvidenceCheckService @PostConstruct
  • Apollo：app.id=antispam-audio_storage

scheduler ​

  • 启动类：com.netease.is.antispam.audio.scheduler.SchedulerApplication
  • @SpringBootApplication；@EnableScheduling、@EnableCdcDataSubscribe、@EnableSchedulerAutoConfiguration（→SchedulerConfiguration：@ComponentScan({"…audio.manager","…audio.component","…audio.scheduler.zookeeper","…audio.service","…audio.redis","…audio.scheduler.tasks","…audio.recover","…audio.scheduler.service","…audio.es","…audio.kafka","…components.callback"}) + @MapperScan("…audio.dao")）、@EnableElasticJob、@EnableDistributeId、@EnableOssClient、@EnableBusinessClient、@EnableRecoverComponent、@EnableApolloConfig
  • main()：无自定义；钩子：YidunQosApplication、AudioReviseTask / CustomModelVerifyTaskWorker / DealingCountReviseWorker @PostConstruct；任务类用 @ElasticJobConf
  • Apollo：app.id=antispam-audio_scheduler

console/api ​

  • 启动类：com.netease.is.antispam.audio.console.api.ConsoleApplication（ConsoleConfiguration / SwaggerConfiguration）
  • 无 Dockerfile、不在 kubernetes.yml

共通：全部启动类 main() 无业务自定义逻辑，仅 SpringApplication.run。

五、启动前置依赖 ​

依赖配置键/地址阻塞 or 弱依赖配置文件
ZooKeeperzookeeper://zk-0.zookeeper.yidun-infra:2181，group /yidun/antispam/online-new/yidun-antispam-dubbo；zookeeper.config.root.path=/netease-antispam/online/config阻塞application-private.properties
PostgreSQLjdbc:postgresql://10.104.68.141:5432/antispam（org.postgresql.Driver，user postgres）；dubbo-provider 另配 master/mirror阻塞（http-api/dubbo-provider/storage/scheduler）application-private.properties
Kafkakafka-yidun-{0,1,2}.kafka-yidun-headless.yidun-infra:9092阻塞（http-check-api/storage/dubbo-check）application-private.properties
Redis Sentinelredis0-redis-ha.yidun-infra.svc:26379，master master01阻塞（限流/缓冲池）application-private.properties
OSSaudio-oss.properties（@PropertySource 显式引用）弱依赖（归档/片段）classpath:audio-oss.properties
Elasticsearchelasticsearch.multiple.*（多实例）弱依赖application-private.properties
Apolloapp.id=antispam-audio_*，apollo.cache-dir=./apollo/cache阻塞application.properties
mplatform-event@EnableEventClient（部分单元）弱依赖—

六、启动参数与 Profile ​

  • -Dspring.profiles.active：默认 dev；Dockerfile 与 k8s 覆盖为 private；仍有 test / online / 各区域 profile 文件（frankfurt/tokyo/virginia/guizhou/tianjin/beijing/jiande/xjp 等）
  • Maven profile：buildAll.sh 以 mvn clean install -P private 后遍历各 build.sh -c false -p false -e private；模块 build.sh -e <env>
  • JAVA_OPTS（Dockerfile）：-Xmx1024m -Xms1024m -XX:+UseG1GC -Dspring.profiles.active=private
  • JAVA_OPTS（k8s 覆写）：-Xmx1024m -Xms1024m -XX:+UseG1GC -Dspring.profiles.active=private（所有 6 个 Deployment，注意双空格）
  • base image：private-registry.nis.netease.com/library/base-image:jdk17；Dockerfile ENV APP_NAME=antispam-business-audio-facade-<unit>；build.sh 推 private-registry.nis.netease.com/yidun/antispam-business-audio-<unit>；k8s 拉 private-registry.yidun.internal/yidun/antispam-business-audio-<unit>:1.0.0.private
  • build.sh 关键参数：-e/-r/-t（默认 base-250409）/-c/-p；docker buildx build --platform linux/amd64,linux/arm64 --push
  • k8s 通用：namespace yidun，replicas=2，env 注入 ENABLE_SKYWALKING=true、SW_AGENT_COLLECTOR_BACKEND_SERVICES=skywalking-skywalking-oap.yidun-infra.svc:11800

七、启动期踩坑 ​

  1. artifactId 无 -api 后缀：http-api = antispam-business-audio-facade-http、http-check-api = antispam-business-audio-facade-http-check；用 -am 构建时若按 -api 猜模块名会找不到。
  2. DubboApplication / DubboCheckApplication / HttpCheckApplication 均 exclude=DataSourceAutoConfiguration，数据源靠 master/mirror 动态数据源装配；http-check-api 甚至不引数据源，误配 DB 反而更糟。
  3. 实际 private 环境数据库是 PostgreSQL（org.postgresql.Driver，POC 10.104.68.141:5432），与 CLAUDE.md/概览里写的 MySQL 不一致；分页/方言写 SQL 时以 properties 为准。
  4. 证据处理链大量 @PostConstruct（AudioEvidenceCheckService、AudioModelCacheService、YidunKafkaNoDelayProducer 等），Redis/Kafka 未就绪会在启动期直接抛错。
  5. storage/scheduler 的 YidunQosApplication.doOffline() 会 pause Kafka 容器并 sleep，k8s terminationGracePeriodSeconds 必须大于该值。
  6. @EnableApolloConfig 单元（http-check/dubbo-check/storage/scheduler）在 Apollo 不可用时启动受阻；apollo.meta 在基础 application.properties 中硬编码为 yd-apollo-config.nistest.netease.com，私有化部署需覆写。
  7. http-check-api 的 FacadeHttpConfiguration 与 http-api 同名、dubbo-provider 与 dubbo-check-provider 的 FacadeConfiguration 同名，排查 bean 冲突时注意区分包路径。
  8. @EnableDistributeId 依赖 ZK distribute.id.zookeeperHost 与 namespace antispam-business-audio；ZK 抖动会导致自增 ID 获取失败。

八、跨模块前置 ​

  • antispam-business：ProductCache/TargetCache/SecretInfoCache/TargetConfigCache/LabelInfoCache 全部来自 business client（@EnableBusinessClient）——硬前置
  • antispam-bill：REQUEST_STAT、Antispam_Bill_CensorStat 计量消息（运行期）
  • antispam-list：IP 区域解析 IpRegionDetail、名单检测
  • antispam-keyword / antispam-rule：Dubbo 检测链 checker
  • 共享组件 components：KafkaSender、YidunLogger、YidunQosApplication、@KafkaConsumer 等
  • 基础设施：ZooKeeper、Kafka、Redis Sentinel、PostgreSQL、Elasticsearch、Apollo、OSS

相关：全局启动顺序 · 部署单元矩阵 · 踩坑速查

内部技术文档 · 请勿外传

网易易盾 · 反垃圾内容安全平台