Execution #5779

Job IDdefault_datagen_full
Job NameDataGen完整流水线
Task Typedatagen_all
Region--
Statussuccess
Start Time2026-06-09 02:00:00
End Time2026-06-09 02:34:25
Duration2065.1s
Parameters{'limit': 0}

Result Summary

{'1.1': {'data': {'fixed': 2, 'checked': 0, 'invalid_fixed': 0}, 'status': 'success'}, '1.2': {'data': {'total': 184574, 'skipped': 0, 'updated': 184574}, 'status': 'success'}, '2.1': {'data': {'marked': 34078, 'cleared': 0}, 'status': 'success'}, '2.2': {'data': {'scored': 184574, 'new_arrivals_marked': 1167, 'new_arrivals_expired': 0}, 'status': 'success'}, '2.3': {'data': {'marked': 3003, 'cleared': 3007}, 'status': 'success'}, '2.4': {'data': {'marked': 731, 'cleared': 729, 'regions': {'ca': 100, 'de': 100, 'es': 100, 'fr': 100, 'it': 100, 'jp': 100, 'uk': 100, 'us': 100}}, 'status': 'success'}, '3.0': {'data': {'matched': 0, 'updated': 0, 'unmatched': 5635, 'candidates': 5635}, 'status': 'success'}, '3.1': {'data': {'zeroed': 0, 'updated': 133, 'reordered': 229}, 'status': 'success'}, '3.2': {'data': {'seeded': 0, 'deleted': 792, 'updated': 0, 'inserted': 792}, 'status': 'success'}, '4.1': {'data': {'type_a': 80, 'type_b': 80, 'type_c': 63, 'type_best_of': 80, 'items_created': 3029}, 'status': 'success'}, '4.2': {'data': {'created': 40, 'deleted': 40, 'regions': {'ca': {'created': 5, 'deleted': 5}, 'de': {'created': 5, 'deleted': 5}, 'es': {'created': 5, 'deleted': 5}, 'fr': {'created': 5, 'deleted': 5}, 'it': {'created': 5, 'deleted': 5}, 'jp': {'created': 5, 'deleted': 5}, 'uk': {'created': 5, 'deleted': 5}, 'us': {'created': 5, 'deleted': 5}}, 'used_product_ids': {'ca': [46762, 3827, 2341], 'de': [1914, 41467, 10285], 'es': [245361, 945, 3860], 'fr': [42354, 1901, 130806], 'it': [245334, 2458, 238070], 'jp': [1632, 32438, 32319], 'uk': [20332, 28947, 2652], 'us': [19778, 206100, 15575]}, 'used_category_ids': {'ca': [458, 469], 'de': [268, 239], 'es': [347, 358], 'fr': [321, 310], 'it': [401, 404], 'jp': [426, 423], 'uk': [291, 284], 'us': [23, 7]}}, 'status': 'success'}, '4.3': {'data': {'created': 48, 'deleted': 48, 'regions': {'ca': {'created': 6, 'deleted': 6}, 'de': {'created': 6, 'deleted': 6}, 'es': {'created': 6, 'deleted': 6}, 'fr': {'created': 6, 'deleted': 6}, 'it': {'created': 6, 'deleted': 6}, 'jp': {'created': 6, 'deleted': 6}, 'uk': {'created': 6, 'deleted': 6}, 'us': {'created': 6, 'deleted': 6}}}, 'status': 'success'}, '4.5': {'data': {'items_count': 12, 'scene_updated': True}, 'status': 'success'}, '4.6': {'data': {'sites_items': 10, 'brand_groups': 9, 'brands_total': 36}, 'status': 'success'}, '5.1': {'data': {'ticker_cleaned': 0, 'cooldown_cleaned': 0, 'new_arrival_expired': 0}, 'status': 'success'}, '6.1': {'data': {'recency': {'updated': 184574}, 'review_health': {'total': 0, 'updated': 0}}, 'status': 'success'}, '6.2': {'data': {'failed': 0, 'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'generated': 0, 'processed': 0}, 'status': 'success'}, '6.3': {'data': {'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'generated': 0, 'processed': 0}, 'status': 'success'}, '6.4': {'data': {'cleared': 3, 'direct_updated': 15, 'category_updated': 24}, 'status': 'success'}, '3.06': {'data': {'l1_to_l2': 0, 'null_fixed': 0}, 'status': 'success'}}

Log Output

G | 序列修复: content_discoverhotspot_id_seq
02:33:40 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:40 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:40 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:40 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:40 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:41 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:42 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:42 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:42 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:43 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:43 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:43 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:44 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:44 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:44 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:45 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:45 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:45 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:46 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:46 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:46 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:47 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:47 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:47 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:48 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:48 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:48 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:48 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:48 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:48 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:49 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:50 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:50 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:50 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:51 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:51 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:52 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:53 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:53 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:54 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:54 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:55 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:55 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:56 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:57 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:58 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:58 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:58 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:59 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:34:00 | DEBUG | 序列修复: content_discoveritem_id_seq
02:34:00 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:34:01 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:34:02 | DEBUG | 序列修复: content_discoveritem_id_seq
02:34:02 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:34:03 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:34:03 | INFO | [Discover] [JP] BestOf=10, Trending=10, Deals=10, UseCase=8, 总=38
02:34:03 | INFO | [Discover] 全部完成: BestOf=80, Trending=80, Deals=80, UseCase=63, 总场景=303, 商品项=3029
02:34:03 | INFO | [Phase 4.1] Discover Scene 完成 (parallel)
02:34:03 | INFO | Phase 4 并行完成: 5 成功, 0 失败, 耗时 353.9s
02:34:03 | INFO | ────────────────────────────────────────
02:34:03 | INFO | 
[Phase 5.1] 过期清理...
02:34:03 | INFO | [Cleanup] 完成: 新品过期=0, Ticker清理=0
02:34:03 | INFO | [Phase 5.1] 过期清理 完成 (0.2s)
02:34:03 | INFO | 
[Phase 6.1] 新鲜度评分 (recency_boost + review_health)...
02:34:03 | INFO | Phase 6.1: freshness_scorer 开始
02:34:23 | INFO | recency_boost 更新: 184574 商品
02:34:23 | INFO | review_health_batch: 0 商品已更新惩罚系数
02:34:23 | INFO | Phase 6.1: freshness_scorer 完成: {'recency': {'updated': 184574}, 'review_health': {'total': 0, 'updated': 0}}
02:34:23 | INFO | [Phase 6.1] 新鲜度评分 (recency_boost + review_health) 完成 (20.1s)
02:34:23 | INFO | 
[Phase 6.2] consensus_summary 生成...
02:34:23 | INFO | consensus_builder 完成: {'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'processed': 0, 'generated': 0, 'failed': 0}
02:34:23 | INFO | [Phase 6.2] consensus_summary 生成 完成 (0.1s)
02:34:23 | INFO | 
[Phase 6.3] faq_schema_json 提取...
02:34:23 | INFO | faq_extraction 完成: {'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'processed': 0, 'generated': 0}
02:34:23 | INFO | [Phase 6.3] faq_schema_json 提取 完成 (0.1s)
02:34:23 | INFO | 
[Phase 6.4] hotspot_boost 聚合...
02:34:25 | INFO | hotspot aggregate: {'direct_updated': 15, 'category_updated': 24, 'cleared': 3}
02:34:25 | INFO | [Phase 6.4] hotspot_boost 聚合 完成 (1.5s)
02:34:25 | INFO | 
============================================================
02:34:25 | INFO | DataGen 流水线完成: 20 成功, 0 失败, 耗时 2065.1s
02:34:25 | INFO | ============================================================