Execution #5513

Job IDdefault_datagen_full
Job NameDataGen完整流水线
Task Typedatagen_all
Region--
Statussuccess
Start Time2026-06-05 02:00:00
End Time2026-06-05 02:33:46
Duration2026.4s
Parameters{'limit': 0}

Result Summary

{'1.1': {'data': {'fixed': 2, 'checked': 0, 'invalid_fixed': 0}, 'status': 'success'}, '1.2': {'data': {'total': 184532, 'skipped': 0, 'updated': 184532}, 'status': 'success'}, '2.1': {'data': {'marked': 34381, 'cleared': 0}, 'status': 'success'}, '2.2': {'data': {'scored': 184532, 'new_arrivals_marked': 1136, 'new_arrivals_expired': 0}, 'status': 'success'}, '2.3': {'data': {'marked': 3014, 'cleared': 3019}, 'status': 'success'}, '2.4': {'data': {'marked': 729, 'cleared': 729, 'regions': {'ca': 100, 'de': 100, 'es': 100, 'fr': 100, 'it': 100, 'jp': 100, 'uk': 100, 'us': 100}}, 'status': 'success'}, '3.0': {'data': {'matched': 0, 'updated': 0, 'unmatched': 5610, 'candidates': 5610}, 'status': 'success'}, '3.1': {'data': {'zeroed': 0, 'updated': 133, 'reordered': 65}, 'status': 'success'}, '3.2': {'data': {'seeded': 0, 'deleted': 792, 'updated': 0, 'inserted': 792}, 'status': 'success'}, '4.1': {'data': {'type_a': 80, 'type_b': 80, 'type_c': 63, 'type_best_of': 80, 'items_created': 3029}, 'status': 'success'}, '4.2': {'error': "(psycopg2.errors.DeadlockDetected) deadlock detected\nLINE 2:         INSERT INTO homepage_cooldown (region, entity_type, ...\n                            ^\nDETAIL:  Process 9810 waits for RowExclusiveLock on relation 1434066 of database 16391; blocked by process 9811.\nProcess 9811 waits for RowExclusiveLock on relation 1434066 of database 16391; blocked by process 9810.\nHINT:  See server log for query details.\n\n[SQL: \n        INSERT INTO homepage_cooldown (region, entity_type, entity_id, slot_name, shown_at)\n        VALUES (%(region)s, %(entity_type)s, %(entity_id)s, %(slot_name)s, now())\n    ]\n[parameters: {'region': 'us', 'entity_type': 'product', 'entity_id': 258627, 'slot_name': 'slide_best_deal'}]\n(Background on this error at: https://sqlalche.me/e/20/e3q8)", 'status': 'failed'}, '4.3': {'data': {'created': 48, 'deleted': 48, 'regions': {'ca': {'created': 6, 'deleted': 6}, 'de': {'created': 6, 'deleted': 6}, 'es': {'created': 6, 'deleted': 6}, 'fr': {'created': 6, 'deleted': 6}, 'it': {'created': 6, 'deleted': 6}, 'jp': {'created': 6, 'deleted': 6}, 'uk': {'created': 6, 'deleted': 6}, 'us': {'created': 6, 'deleted': 6}}}, 'status': 'success'}, '4.5': {'data': {'items_count': 12, 'scene_updated': True}, 'status': 'success'}, '4.6': {'data': {'sites_items': 10, 'brand_groups': 9, 'brands_total': 36}, 'status': 'success'}, '5.1': {'data': {'ticker_cleaned': 0, 'cooldown_cleaned': 0, 'new_arrival_expired': 0}, 'status': 'success'}, '6.1': {'data': {'recency': {'updated': 184532}, 'review_health': {'total': 0, 'updated': 0}}, 'status': 'success'}, '6.2': {'data': {'failed': 0, 'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'generated': 0, 'processed': 0}, 'status': 'success'}, '6.3': {'data': {'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'generated': 0, 'processed': 0}, 'status': 'success'}, '6.4': {'data': {'cleared': 6, 'direct_updated': 15, 'category_updated': 22}, 'status': 'success'}, '3.06': {'data': {'l1_to_l2': 0, 'null_fixed': 0}, 'status': 'success'}}

Log Output

ent_discoverscenecategory_id_seq
02:33:18 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:18 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:18 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:18 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:18 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:19 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:19 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:19 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:19 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:19 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:20 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:20 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:20 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:20 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:21 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:21 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:21 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:21 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:21 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:21 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:22 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:22 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:22 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:22 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:23 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:23 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:23 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:23 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:23 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:24 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:25 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:25 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:25 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:26 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:26 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:26 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:27 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:27 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:27 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:28 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:28 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:28 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:29 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:29 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:29 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:30 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:30 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:30 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:31 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:31 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:31 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:32 | DEBUG | 序列修复: content_discoveritem_id_seq
02:33:32 | DEBUG | 序列修复: content_discoverhotspot_id_seq
02:33:32 | DEBUG | 序列修复: content_discoverscenecategory_id_seq
02:33:32 | INFO | [Discover] [JP] BestOf=10, Trending=10, Deals=10, UseCase=8, 总=38
02:33:32 | INFO | [Discover] 全部完成: BestOf=80, Trending=80, Deals=80, UseCase=63, 总场景=303, 商品项=3029
02:33:32 | INFO | [Phase 4.1] Discover Scene 完成 (parallel)
02:33:32 | INFO | Phase 4 并行完成: 4 成功, 1 失败, 耗时 252.4s
02:33:32 | INFO | ────────────────────────────────────────
02:33:32 | INFO | 
[Phase 5.1] 过期清理...
02:33:33 | INFO | [Freshness] Cleaned up 251 expired cooldown records
02:33:33 | INFO | [Cleanup] 完成: 新品过期=0, Ticker清理=0
02:33:33 | INFO | [Phase 5.1] 过期清理 完成 (0.2s)
02:33:33 | INFO | 
[Phase 6.1] 新鲜度评分 (recency_boost + review_health)...
02:33:33 | INFO | Phase 6.1: freshness_scorer 开始
02:33:44 | INFO | recency_boost 更新: 184532 商品
02:33:44 | INFO | review_health_batch: 0 商品已更新惩罚系数
02:33:44 | INFO | Phase 6.1: freshness_scorer 完成: {'recency': {'updated': 184532}, 'review_health': {'total': 0, 'updated': 0}}
02:33:44 | INFO | [Phase 6.1] 新鲜度评分 (recency_boost + review_health) 完成 (11.8s)
02:33:44 | INFO | 
[Phase 6.2] consensus_summary 生成...
02:33:45 | INFO | consensus_builder 完成: {'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'processed': 0, 'generated': 0, 'failed': 0}
02:33:45 | INFO | [Phase 6.2] consensus_summary 生成 完成 (0.1s)
02:33:45 | INFO | 
[Phase 6.3] faq_schema_json 提取...
02:33:45 | INFO | faq_extraction 完成: {'regions': ['us', 'uk', 'de', 'fr', 'jp', 'es'], 'processed': 0, 'generated': 0}
02:33:45 | INFO | [Phase 6.3] faq_schema_json 提取 完成 (0.1s)
02:33:45 | INFO | 
[Phase 6.4] hotspot_boost 聚合...
02:33:46 | INFO | hotspot aggregate: {'direct_updated': 15, 'category_updated': 22, 'cleared': 6}
02:33:46 | INFO | [Phase 6.4] hotspot_boost 聚合 完成 (1.3s)
02:33:46 | INFO | 
============================================================
02:33:46 | INFO | DataGen 流水线完成: 19 成功, 1 失败, 耗时 2026.1s
02:33:46 | INFO | ============================================================