I1007 19:43:41.018189 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:43:41.022292 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:43:53.031743 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:43:53.037157 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:44:05.050688 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:44:05.058344 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
E1007 19:44:15.067048 78574 counters.py:319] 2294.32M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:44:17.074497 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:44:17.081549 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:44:29.091166 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:44:29.095388 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:44:41.104959 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:44:41.110970 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:44:53.120655 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:44:53.125234 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:45:05.135572 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:45:05.140485 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
E1007 19:45:15.145978 78574 counters.py:319] 2294.32M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:45:17.151154 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:45:17.158120 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:45:29.175182 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:45:29.180511 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:45:41.269716 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:45:41.273614 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:45:53.281769 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:45:53.286478 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:46:05.302279 78574 worker.py:183] 2294.32M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:46:05.307044 78574 worker.py:275] 2294.32M Fetching messages from queue test_nagrawal_queue...
I1007 19:46:17.107318 78574 worker.py:297] 2294.32M Received 2 messages from queue test_nagrawal_queue with IDs: ['075205bd-f5a9-4205-a8e7-059ded730392', 'e70c7c2c-8732-4127-a711-feb547dd4ea9']
I1007 19:46:17.107999 78574 worker.py:477] 2294.32M Starting processing of message 075205bd-f5a9-4205-a8e7-059ded730392 received at 2025-10-07 19:46:06.000000 with timeout at 2025-10-07 20:16:06.000000
I1007 19:46:17.110213 78574 request_tracelog.py:76] 2294.32M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: True and mem_profile: True
I1007 19:46:17.124571 78574 worker.py:579] 2294.32M TimeToStart for first op entity_index is: 11. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.set', {'num': 1, 'total_ms': 2}], ['redis.get', {'num': 1, 'total_ms': 1}]]. PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.125408 78574 worker.py:598] 2294.32M Invoking preprocess for entity_index op PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.126246 78574 worker.py:603] 2294.32M Invoking handle for entity_index op PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.359070 78574 entity_index_operation.py:308] 2297.07M index_update_time for 4407605: 1759866377 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.364356 78574 entity_index_operation.py:531] 2297.07M Solr batch add_to_index: 1 ec2-34-210-80-127.us-west-2.compute.amazonaws.com PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.379618 78574 entity_index_operation.py:531] 2297.07M Solr batch add_to_index: 1 ec2-52-33-217-198.us-west-2.compute.amazonaws.com PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
W1007 19:46:17.390609 78574 worker.py:621] 2297.07M Op handler return falsy status: None {'operations': ['entity_index'], '_traceback': '__EFCmPr-LZ4HC-B64::BCJNGGhA1woAAAAAAAC8BQQAAPNCICBGaWxlICIvaG9tZS9lYzItdXNlci92c2NvZGUvd3d3L3Byb2Nlc3Nvci9xdWV1ZV91dGlscy5weSIsIGxpbmUgNTgwLCBpbiBhZGRfdG9fLwBBaW5nXzAA8xQKICAgIHBheWxvYWRbJ190cmFjZWJhY2snXSA9IHRocmVhZFMA/w5jdXJyZW50X3N0YWNrKGNvbXByZXNzPVRydWUpCqgAD2BkYi9kYl9nACdlcp8AQTIyNzagAPEEdXBkYXRlX3NlYXJjaF9pbmRleJwACNYAD8QABB8ofwAoMTE4OH8AMnNhdgwBX3NlbGYujQAAEiiJAP8JbmFtZSwgY29tbWl0X2ltbWVkaWF0ZWx5AwERQGFwcHMFAMZfc2NoZWR1bGluZy8LAIdfc2VydmljZZ4AKTEyHAHwAmRldGFpbHNfb25fYWlfaW50MQAwZXdfjAFhbGV0aW9uwgDwAGNhbGVuZGFyX2V2ZW50LtoAHyifABHBdm9pY2Vfc2NyZWVumwAAZAFGb25zL2oAAxMAB6MAMTMxN6MAUHBvc3RfawAwX2FjigASc00BDt4AD8wAFh8oswBFPzI4N/MBAA3BAA80AUgoOTnXAWZzdGF0dXOKAA+xARYIOQEGegBEY2FsbHUAHi99ADg0MDh9AA2oAAiPAA4dAElvYmoutwASKAcAD68AHiBlbJ4C0WxhYnNfYWRhcHRlci+CAQG+AEtob29rDwAPHgMBIjE1ewICDwQE/AIYbK0AT2VjdC7qAAwkKEkZABFTEAD/BS5JTlRFUlZJRVdfQ09NUExFVEVE3gMWCxACR19hcHDrAEgvYXBp+gAL4wA4YXBp3wAoMzHfAIFfcmVxdWVzdOcADxwBAwTxAAMyAB8otgBiJTU0EAQBqwB/cmVzcCA9IEAABwPYABsu6AAPvgAH8AdweTMuMTMtdmlydC9saWIvcHl0aG9uFAD4Cy9zaXRlLXBhY2thZ2VzL3dlYmFyZ3MvY29yOAIiNDV/A3N3cmFwcGVypgDwAHR1cm4gZnVuYygqbmV3XzkAYCwgKiprdwoAD0oBEQGjBrkvZGVjb3JhdG9yc2YGHzRyAAkB7gQfKnIAOy42MHIAP3YgPXAABg9uAS9AZmxhc84BqXN0eC9yZXNvdXKuAxI0ywaJZGlzcGF0Y2jPAgMkAk9tZXRomABEEC/gAwghASIxMAUGABgACJABBOYI8QFhcHAuZW5zdXJlX3N5bmMomgUMvQAvKSg/AUMKUwM/NDA1PgIAATIBBGgBDzYBPxBnrwNgdC9iYXNlXgQJNQkSM84C+AxfaGFuZGxlX2FuZF9jbG9zZV93aGVuX2RvbmVSAQImAAKiAIBfdHVwbGUpCgAAAAA=', '_parent_msg_id': 'Unknown-1fb018d6df2a41f4a5e8856c477251b1', '_parent_trace_id': '1fb018d6df2a41f4a5e8856c477251b1', '_message_dispatched_ts': 1759866366.1998334, '_dispatch_host': '172.31.27.172', '_queue_name': 'index_requests', '_interceptor_stack': ['prod:user_calendar_events:4407605'], '_workflow_recipe_ids': [], '_db_access_override_group_id': None, 'group_id': 'eightfolddemo-voice-screening.com', 'tablename': 'user_calendar_events', 'entity_id': 4407605} PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.391584 78574 queue_utils.py:212] 2297.07M Deleting message 075205bd-f5a9-4205-a8e7-059ded730392 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.402702 78574 worker.py:747] 2297.07M [OpLevelPerfStats] Op: entity_index. Performance Stats: {'CPUTime': 0, 'BlockingTime': 0, 'NonPatchedBlockingTime': 0, 'WallClockTime': 0.2939455509185791, 'WaitTime': 0.2939455509185791, 'TotalEventIOTime': 0.048, 'RSSMemUsed': 'NA'} PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.404227 78574 request_tracelog.py:307] 2297.07M processor_test_nagrawal_queue: Total latency ms: 295, Event latency ms: 100, Num events: 15, Mem used: 2 MB, (Event, count, latency ms): [['entity_index', {'num': 1, 'total_ms': 266}], ['redis.get', {'num': 38, 'total_ms': 45}], ['prod_db_read', {'num': 4, 'total_ms': 18}], ['prod0_db_read', {'num': 4, 'total_ms': 12}], ['prod0_db_read_candidate_profiles', {'num': 2, 'total_ms': 8}], ['prod_db_read_sourcing_profiles', {'num': 1, 'total_ms': 8}], ['request.ec2-34-210-80-127.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 8}], ['prod_db_read_user_login', {'num': 2, 'total_ms': 7}], ['redis.set', {'num': 3, 'total_ms': 6}], ['prod0_db_read_candidates', {'num': 2, 'total_ms': 4}]], Slowest 3 events [{'idx': 11, 'event': 'entity_index', 'latency_ms': 266.1, 'extra': '{"operations": ["entity_index"], "_traceback": "truncated", "_parent_msg_id": "Unknown-1fb018d6df2a41f4a5e8856c477251b1", "_parent_trace_id": "1fb018d6df2a41f4a5e8856c477251b1", "_message_dispatched_ts": 1759866366.1998334, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_interceptor_stack": ["prod:user_calendar_events:4407605"], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "group_id": "eightfolddemo-voice-screening.com", "tablename": "user_calendar_events", "entity_id": 4407605}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 45, 'extra': {'num': 38, 'config': 36, 'solr_indexing_pause': 2}}, {'idx': 4, 'event': 'prod_db_read', 'latency_ms': 9.0, 'extra': '{"query": "SELECT * FROM sourcing_profiles WHERE id=%s LIMIT 1 /* dev=nagrawal */", "breakdowns": ["sourcing_profiles"], "retries": []}', 'rows_returned': 1}] PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
I1007 19:46:17.405168 78574 worker.py:759] 2297.07M Ending processing of message 075205bd-f5a9-4205-a8e7-059ded730392 latency: 0.29009413719177246 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 075205bd-f5a9-4205-a8e7-059ded730392
E1007 19:46:17.406332 78574 counters.py:319] 2297.07M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:46:17.407794 78574 worker.py:477] 2297.07M Starting processing of message e70c7c2c-8732-4127-a711-feb547dd4ea9 received at 2025-10-07 19:46:07.000000 with timeout at 2025-10-07 20:16:07.000000
I1007 19:46:17.412764 78574 request_tracelog.py:76] 2297.07M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:46:17.429908 78574 worker.py:579] 2297.07M TimeToStart for first op entity_index is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 6, 'total_ms': 6}], ['redis.set', {'num': 1, 'total_ms': 2}], ['redis.pipeline', {'num': 1, 'total_ms': 1}]]. PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.431029 78574 worker.py:598] 2297.07M Invoking preprocess for entity_index op PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.431700 78574 worker.py:603] 2297.07M Invoking handle for entity_index op PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.540675 78574 entity_index_operation.py:308] 2297.07M index_update_time for 12030704: 1759866377 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.543974 78574 entity_index_operation.py:531] 2297.07M Solr batch add_to_index: 1 ec2-35-164-235-186.us-west-2.compute.amazonaws.com PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.553491 78574 entity_index_operation.py:531] 2297.07M Solr batch add_to_index: 1 ec2-35-91-247-119.us-west-2.compute.amazonaws.com PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
W1007 19:46:17.562566 78574 worker.py:621] 2297.07M Op handler return falsy status: None {'operations': ['entity_index'], '_traceback': '__EFCmPr-LZ4HC-B64::BCJNGGhA0woAAAAAAADFBAQAAPNCICBGaWxlICIvaG9tZS9lYzItdXNlci92c2NvZGUvd3d3L3Byb2Nlc3Nvci9xdWV1ZV91dGlscy5weSIsIGxpbmUgNTgwLCBpbiBhZGRfdG9fLwBBaW5nXzAA8xQKICAgIHBheWxvYWRbJ190cmFjZWJhY2snXSA9IHRocmVhZFMA/w5jdXJyZW50X3N0YWNrKGNvbXByZXNzPVRydWUpCqgAD2BkYi9kYl9nACdlcp8AQTIyNzagAPEEdXBkYXRlX3NlYXJjaF9pbmRleJwACNYAD8QABB8ofwAoMTE4OH8AMnNhdgwBX3NlbGYujQAAEiiJAP8JbmFtZSwgY29tbWl0X2ltbWVkaWF0ZWx5AwERQGFwcHMFAMZfc2NoZWR1bGluZy8LAIdfc2VydmljZZ4AODEzNRwB8AJkZXRhaWxzX29uX2FpX2ludDEAMGV3X4wBYWxldGlvbsIAsHByb2ZpbGVfZmIu1gAfKJsAEcF2b2ljZV9zY3JlZW6XAABgAUZvbnMvZgADEwAHnwAxMzE3nwBQcG9zdF9rADBfYWOGABJzSQEO2gAPyAAWHyizAEU/Mjg37wEADcEADzQBSCg5OdMBZnN0YXR1c4oAD7EBFgg5AQZ6AERjYWxsdQAeL30AODQwOH0ADagACI8ADh0ASW9iai63ABIoBwAPrwAe8QRlbGV2ZW5sYWJzX2FkYXB0ZXIvggEBvgBLaG9vaw8ADxoDARIxGgMDCwQBsgAI/QAArQBPZWN0LuoADCQoSRkAEVMQAP8FLklOVEVSVklFV19DT01QTEVURUTaAxYLEAJHX2FwcOsASC9hcGn6AAvjADhhcGnfACgzMd8AgV9yZXF1ZXN05wAPHAEDBPEAAzIAHyi2AGIlNTQQBAGrAH9yZXNwID0gQAAHA9gAGy7oAA++AAfwB3B5My4xMy12aXJ0L2xpYi9weXRob24UAPgLL3NpdGUtcGFja2FnZXMvd2ViYXJncy9jb3I4AiI0NX8Dc3dyYXBwZXKmAPAAdHVybiBmdW5jKCpuZXdfOQBgLCAqKmt3CgAPSgERAZ8GuS9kZWNvcmF0b3JzYgYfNHIACQHuBB8qcgA7LjYwcgA/diA9cAAGD24BL0BmbGFzzgGpc3R4L3Jlc291cq4DEjTjB4lkaXNwYXRjaM8CAyQCT21ldGiYAEQQL+ADCCEBIjEwBQYAGAAIkAEE4gjxAWFwcC5lbnN1cmVfc3luYyiaBQy9AC8pKD8BQwpTAz80MDU+AgABMgEEaAEPNgE/EGevA2B0L2Jhc2VeBAkxCRIzzgL4DF9oYW5kbGVfYW5kX2Nsb3NlX3doZW5fZG9uZVIBAiYAAqIAgF90dXBsZSkKAAAAAA==', '_parent_msg_id': 'Unknown-1fb018d6df2a41f4a5e8856c477251b1', '_parent_trace_id': '1fb018d6df2a41f4a5e8856c477251b1', '_message_dispatched_ts': 1759866367.0344067, '_dispatch_host': '172.31.27.172', '_queue_name': 'index_requests', '_interceptor_stack': ['prod:profile_feedback:12030704'], '_workflow_recipe_ids': [], '_db_access_override_group_id': None, 'group_id': 'eightfolddemo-voice-screening.com', 'tablename': 'profile_feedback', 'entity_id': 12030704} PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.563532 78574 queue_utils.py:212] 2297.07M Deleting message e70c7c2c-8732-4127-a711-feb547dd4ea9 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.576475 78574 request_tracelog.py:307] 2297.07M processor_test_nagrawal_queue: Total latency ms: 166, Event latency ms: 73, Num events: 14, Mem used: 0 MB, (Event, count, latency ms): [['entity_index', {'num': 1, 'total_ms': 132}], ['redis.get', {'num': 24, 'total_ms': 27}], ['prod_db_read', {'num': 8, 'total_ms': 25}], ['prod_db_read_profile_feedback', {'num': 4, 'total_ms': 10}], ['prod_db_read_candidate_profiles', {'num': 1, 'total_ms': 7}], ['request.ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 5}], ['request.ec2-35-91-247-119.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 5}], ['redis.set', {'num': 2, 'total_ms': 4}], ['prod_db_read_sourcing_profiles', {'num': 1, 'total_ms': 4}], ['prod_db_read_profile_data', {'num': 2, 'total_ms': 4}]], Slowest 3 events [{'idx': 10, 'event': 'entity_index', 'latency_ms': 132.5, 'extra': '{"operations": ["entity_index"], "_traceback": "truncated", "_parent_msg_id": "Unknown-1fb018d6df2a41f4a5e8856c477251b1", "_parent_trace_id": "1fb018d6df2a41f4a5e8856c477251b1", "_message_dispatched_ts": 1759866367.0344067, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_interceptor_stack": ["prod:profile_feedback:12030704"], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "group_id": "eightfolddemo-voice-screening.com", "tablename": "profile_feedback", "entity_id": 12030704}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 27, 'extra': {'num': 24, 'config_hash': 16, 'config': 7, 'solr_indexing_pause': 1}}, {'idx': 1, 'event': 'prod_db_read', 'latency_ms': 7.8, 'extra': '{"query": "SELECT * FROM candidate_profiles WHERE id=%s LIMIT 1 /* dev=nagrawal */", "breakdowns": ["candidate_profiles"], "retries": []}', 'rows_returned': 1}] PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.576913 78574 worker.py:759] 2297.07M Ending processing of message e70c7c2c-8732-4127-a711-feb547dd4ea9 latency: 0.16532254219055176 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: e70c7c2c-8732-4127-a711-feb547dd4ea9
I1007 19:46:17.579856 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:46:17.584736 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:46:29.595379 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:46:29.604674 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:46:41.619626 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:46:41.623574 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:46:53.634803 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:46:53.641490 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:47:05.658583 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:47:05.664420 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:47:17.674829 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:47:17.681699 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:47:27.688400 78574 firehose_utils.py:98] 2297.07M Publishing processor_event_log to firehose with 4 entries
I1007 19:47:27.771523 78574 firehose_utils.py:98] 2297.07M Publishing search_query_log to firehose with 4 entries
E1007 19:47:27.782319 78574 counters.py:319] 2297.07M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:47:29.787252 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:47:29.791174 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:47:41.802161 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:47:41.806359 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:47:53.817007 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:47:53.821349 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:48:05.831788 78574 worker.py:183] 2297.07M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:48:05.837205 78574 worker.py:275] 2297.07M Fetching messages from queue test_nagrawal_queue...
I1007 19:48:17.464801 78574 worker.py:297] 2297.07M Received 1 messages from queue test_nagrawal_queue with IDs: ['439cef36-4329-4069-8a56-4799af17bae7']
I1007 19:48:17.465717 78574 worker.py:477] 2297.07M Starting processing of message 439cef36-4329-4069-8a56-4799af17bae7 received at 2025-10-07 19:48:07.000000 with timeout at 2025-10-07 20:18:07.000000
I1007 19:48:17.484407 78574 request_tracelog.py:76] 2297.07M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:48:17.506155 78574 worker.py:579] 2297.07M TimeToStart for first op post_ai_interview_call_processing is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 5, 'total_ms': 7}], ['redis.set', {'num': 1, 'total_ms': 2}], ['redis.pipeline', {'num': 1, 'total_ms': 1}]]. PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.507056 78574 worker.py:598] 2297.07M Invoking preprocess for post_ai_interview_call_processing op PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.507626 78574 worker.py:603] 2297.07M Invoking handle for post_ai_interview_call_processing op PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.638586 78574 boto_utils.py:1256] 2297.07M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.639218 78574 post_ai_interview_call_processing_operation.py:34] 2297.07M Processing recordings for interview session 77215 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
E1007 19:48:17.655103 78574 boto_utils.py:1739] 2297.07M S3 path does not exist: bucket vs-crawldata and key ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json ... PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.655501 78574 session.py:396] 2297.07M Debug log file doesn't exist yet for session 77215, creating new file PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.656012 78574 boto_utils.py:1049] 2297.07M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.702261 78574 session.py:414] 2297.07M Added debug log entry for session 77215, operation: post_ai_interview_call_processing_operation PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.702746 78574 interview_session.py:395] 2297.07M Interview session 2e43cb8308c149229946386ff503fb6e already has status InterviewStatus.INTERVIEW_COMPLETED PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.703405 78574 post_ai_interview_call_processing_operation.py:45] 2297.07M Interview ended 77215 for group eightfolddemo-voice-screening.com PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:17.708348 78574 ai_interview_queueing_service.py:21] 2297.07M [AIInterviewQueueingService] Queueing ai_interview_rag_eval_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.039086 78574 queue_utils.py:688] 2298.82M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_rag_eval_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1545 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.042102 78574 boto_utils.py:587] 2298.82M Found sqs_queue test_nagrawal_queue in cache PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.064687 78574 queue_utils.py:727] 2298.82M Queued processor message id=cd212841-c05d-4845-abb5-9d518a0ee253 operations=['ai_interview_rag_eval_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.065300 78574 ai_interview_queueing_service.py:21] 2298.82M [AIInterviewQueueingService] Queueing ai_interview_media_processing_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.079881 78574 queue_utils.py:688] 2299.32M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_media_processing_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1589 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.080384 78574 boto_utils.py:587] 2299.32M Found sqs_queue test_nagrawal_queue in cache PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.097353 78574 queue_utils.py:727] 2299.32M Queued processor message id=4d868914-7a04-45e4-aba1-31cf14de73af operations=['ai_interview_media_processing_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.115639 78574 ai_interview_queueing_service.py:21] 2299.45M [AIInterviewQueueingService] Queueing ai_interview_eval_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.245839 78574 queue_utils.py:688] 2301.57M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_eval_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1666 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.246393 78574 boto_utils.py:587] 2301.57M Found sqs_queue test_nagrawal_queue in cache PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.262029 78574 queue_utils.py:727] 2301.57M Queued processor message id=27138ec2-5e02-4372-ac01-14423a6d7038 operations=['ai_interview_eval_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.263023 78574 queue_utils.py:212] 2301.57M Deleting message 439cef36-4329-4069-8a56-4799af17bae7 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.273429 78574 request_tracelog.py:307] 2301.57M processor_test_nagrawal_queue: Total latency ms: 790, Event latency ms: 773, Num events: 15, Mem used: 4 MB, (Event, count, latency ms): [['post_ai_interview_call_processing', {'num': 1, 'total_ms': 756}], ['sqs_queue', {'num': 3, 'total_ms': 521}], ['download_from_s3', {'num': 1, 'total_ms': 117}], ['ef_queue_send_message', {'num': 3, 'total_ms': 49}], ['upload_to_s3', {'num': 1, 'total_ms': 46}], ['redis.get', {'num': 14, 'total_ms': 22}], ['redis.set', {'num': 4, 'total_ms': 6}], ['prod_db_read', {'num': 2, 'total_ms': 5}], ['prod_db_read_user_login', {'num': 1, 'total_ms': 3}], ['redis.pipeline', {'num': 2, 'total_ms': 2}]], Slowest 3 events [{'idx': 8, 'event': 'post_ai_interview_call_processing', 'latency_ms': 756.1, 'extra': '{"operations": ["post_ai_interview_call_processing"], "_traceback": "truncated", "_parent_msg_id": "Unknown-1fb018d6df2a41f4a5e8856c477251b1", "_parent_trace_id": "1fb018d6df2a41f4a5e8856c477251b1", "_message_dispatched_ts": 1759866487.3777618, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "import@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215, "call_session_count": 1}', 'is_aggregate_event': True}, {'idx': 2, 'event': 'sqs_queue', 'latency_ms': 348.6, 'extra': '{"queue": "test_nagrawal_queue", "op": ["ai_interview_rag_eval_operation"]}'}, {'idx': 7, 'event': 'sqs_queue', 'latency_ms': 143.7, 'extra': '{"queue": "test_nagrawal_queue", "op": ["ai_interview_eval_operation"]}'}] PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.273931 78574 worker.py:759] 2301.57M Ending processing of message 439cef36-4329-4069-8a56-4799af17bae7 latency: 0.8040406703948975 PMID: 1fb018d6df2a41f4a5e8856c477251b1 SMID: 439cef36-4329-4069-8a56-4799af17bae7
I1007 19:48:18.276753 78574 worker.py:183] 2301.57M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:48:18.283568 78574 worker.py:275] 2301.57M Fetching messages from queue test_nagrawal_queue...
I1007 19:48:28.381551 78574 worker.py:297] 2301.7M Received 3 messages from queue test_nagrawal_queue with IDs: ['cd212841-c05d-4845-abb5-9d518a0ee253', '4d868914-7a04-45e4-aba1-31cf14de73af', '27138ec2-5e02-4372-ac01-14423a6d7038']
I1007 19:48:28.382134 78574 worker.py:477] 2301.7M Starting processing of message cd212841-c05d-4845-abb5-9d518a0ee253 received at 2025-10-07 19:48:18.000000 with timeout at 2025-10-07 20:18:18.000000
I1007 19:48:28.397277 78574 request_tracelog.py:76] 2301.7M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:48:28.409183 78574 worker.py:579] 2301.82M TimeToStart for first op ai_interview_rag_eval_operation is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 1, 'total_ms': 1}], ['redis.set', {'num': 1, 'total_ms': 1}]]. PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.410080 78574 worker.py:598] 2301.82M Invoking preprocess for ai_interview_rag_eval_operation op PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.410699 78574 worker.py:603] 2301.82M Invoking handle for ai_interview_rag_eval_operation op PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.412516 78574 ai_interview_rag_eval_operation.py:30] 2301.82M Triggering RAG Evaluation for group_id: eightfolddemo-voice-screening.com, interview session: 77215 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.547640 78574 boto_utils.py:1256] 2302.32M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.548630 78574 boto_utils.py:1049] 2302.32M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.577723 78574 session.py:414] 2302.32M Added debug log entry for session 77215, operation: ai_interview_rag_eval_operation PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.610079 78574 boto_utils.py:1256] 2302.32M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:28.655484 78574 boto_utils.py:1256] 2302.32M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
W1007 19:48:28.657806 78574 transcript.py:160] 2302.45M Empty message for transcript item 15 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
W1007 19:48:28.658209 78574 transcript.py:160] 2302.45M Empty message for transcript item 15 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:31.187949 78574 _client.py:1038] 2305.82M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:31.245282 78574 ai_interview_rag_eval_log.py:125] 2306.45M Get canonical question List DB query = SELECT DISTINCT canonical_question FROM ai_interview_rag_eval_log WHERE group_id = 'eightfolddemo-voice-screening.com' AND position_id = 27983252 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:31.264249 78574 hodor_client.py:144] 2306.7M Using mapped cluster 0 for hodor redshift_log PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:31.265168 78574 hodor_client.py:56] 2306.7M Executing in Hodor: query (SELECT DISTINCT canonical_question FROM ai_interview_rag_eval_log WHERE group_id = 'eightfolddemo-voice-screening.com' AND position_id = 27983252 /* dev=nagrawal */;) vals (()), db (redshift_log) PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:32.626611 78574 _client.py:1038] 2308.82M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:32.681575 78574 canonical_question_service.py:135] 2309.32M Successfully ran and saved the AI Interview Unanswered questions processing for position_id: 27983252, group_id: eightfolddemo-voice-screening.com PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:32.686319 78574 context_retriever.py:46] 2309.32M Initialized context for profile 473031799 in group_id: eightfolddemo-voice-screening.com PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:32.686784 78574 context_retriever.py:63] 2309.32M Cleared local context stores on exit. PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:33.894046 78574 _client.py:1038] 2310.82M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:33.940141 78574 ai_interview_rag_eval_service.py:224] 2311.07M Successfully updated RAG eval results for 1 turns to the redshift table for interview session 77215 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:33.941626 78574 queue_utils.py:212] 2311.07M Deleting message cd212841-c05d-4845-abb5-9d518a0ee253 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:33.952106 78574 request_tracelog.py:307] 2311.07M processor_test_nagrawal_queue: Total latency ms: 5556, Event latency ms: 222, Num events: 12, Mem used: 9 MB, (Event, count, latency ms): [['ai_interview_rag_eval_operation', {'num': 1, 'total_ms': 5531}], ['download_from_s3', {'num': 3, 'total_ms': 85}], ['request.stage0-hodor5.eba-q2fguank.us-west-2.elasticbeanstalk.com.post', {'num': 1, 'total_ms': 81}], ['upload_to_s3', {'num': 1, 'total_ms': 29}], ['prod_db_read', {'num': 5, 'total_ms': 12}], ['redis.get', {'num': 10, 'total_ms': 10}], ['prod_db_read_sourcing_profiles', {'num': 2, 'total_ms': 6}], ['prod_db_read_interview_session', {'num': 2, 'total_ms': 4}], ['redis.set', {'num': 2, 'total_ms': 3}], ['prod_db_read_call_session', {'num': 1, 'total_ms': 2}]], Slowest 3 events [{'idx': 6, 'event': 'ai_interview_rag_eval_operation', 'latency_ms': 5531.5, 'extra': '{"operations": ["ai_interview_rag_eval_operation"], "_traceback": "truncated", "_parent_msg_id": "439cef36-4329-4069-8a56-4799af17bae7", "_parent_trace_id": "b2f95ca9fa6a44949f3afd868f08a9df", "_message_dispatched_ts": 1759866497.7166638, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "air-freshly.created.agent@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "interview_session_id": 77215}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'download_from_s3', 'latency_ms': 85, 'extra': {'num': 3}}, {'idx': 4, 'event': 'request.stage0-hodor5.eba-q2fguank.us-west-2.elasticbeanstalk.com.post', 'latency_ms': 81.1, 'extra': '{"endpoint": "execute", "status": 200, "url": "http://stage0-hodor5.eba-q2fguank.us-west-2.elasticbeanstalk.com/execute", "query": "SELECT DISTINCT canonical_question FROM ai_interview_rag_eval_log WHERE group_id = \'eightfolddemo-vo (+65 chars)", "db": "redshift_log", "service_request_id": "11bef3f24a58408fbecbad939db50ab6"}'}] PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
I1007 19:48:33.952790 78574 worker.py:759] 2311.07M Ending processing of message cd212841-c05d-4845-abb5-9d518a0ee253 latency: 5.565951108932495 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: cd212841-c05d-4845-abb5-9d518a0ee253
E1007 19:48:33.953993 78574 counters.py:319] 2311.07M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:48:33.956428 78574 worker.py:477] 2311.07M Starting processing of message 4d868914-7a04-45e4-aba1-31cf14de73af received at 2025-10-07 19:48:18.000000 with timeout at 2025-10-07 20:18:18.000000
I1007 19:48:33.975295 78574 request_tracelog.py:76] 2311.07M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: True and mem_profile: True
I1007 19:48:33.992472 78574 worker.py:579] 2311.2M TimeToStart for first op ai_interview_media_processing_operation is: 15. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 2, 'total_ms': 6}], ['redis.set', {'num': 1, 'total_ms': 2}]]. PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:33.993272 78574 worker.py:598] 2311.2M Invoking preprocess for ai_interview_media_processing_operation op PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:33.993760 78574 worker.py:603] 2311.2M Invoking handle for ai_interview_media_processing_operation op PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.033613 78574 boto_utils.py:1256] 2311.2M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.074849 78574 boto_utils.py:1256] 2311.2M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.075636 78574 boto_utils.py:1049] 2311.2M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.110375 78574 session.py:414] 2311.2M Added debug log entry for session 77215, operation: ai_interview_media_processing_operation PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.110812 78574 ai_interview_media_processing_service.py:349] 2311.2M Processing recordings for session 2e43cb8308c149229946386ff503fb6e PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
E1007 19:48:34.144079 78574 boto_utils.py:1739] 2311.2M S3 path does not exist: bucket vs-crawldata and key ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav ... PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.145038 78574 session.py:493] 2311.2M ElevenLabs recording not found in S3, fetching from ElevenLabs for conversation_id: conv_6401k70366vnfg091maf28rbzznm PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.248631 78574 boto_utils.py:635] 2311.57M Failed to load secret ELEVENLABS_API_KEY as json, returning as string PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.660122 78574 _client.py:1038] 2312.07M HTTP Request: GET https://api.elevenlabs.io/v1/convai/conversations/conv_6401k70366vnfg091maf28rbzznm/audio "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.789935 78574 boto_utils.py:1049] 2317.95M Uploading file to s3://vs-crawldata/ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.897450 78574 session.py:246] 2318.95M Successfully uploaded ElevenLabs recording to S3 for conversation_id: conv_6401k70366vnfg091maf28rbzznm, path: ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.901446 78574 ai_interview_media_processing_service.py:37] 2318.95M Completing multipart upload for session 2e43cb8308c149229946386ff503fb6e PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:34.911614 78574 ai_interview_media_processing_service.py:40] 2318.95M Completing multipart upload for call session group_id='eightfolddemo-voice-screening.com' parent_id=77215 status=<SessionStatus.CALL_DISCONNECTED: 'call_disconnected'> t_create=datetime.datetime(2025, 10, 7, 19, 43, 13) t_update=datetime.datetime(2025, 10, 7, 19, 46, 3) t_call_start=datetime.datetime(2025, 10, 7, 19, 43, 18) t_call_end=datetime.datetime(2025, 10, 7, 19, 45, 56) data_json=CallSessionDataJSONModel(channel=<InterviewChannel.WEB: 'web'>, language='en', elevenlabs_data=ElevenLabsData(conversation_id='conv_6401k70366vnfg091maf28rbzznm'), call_sid='9bf66107afe44867a46167c59c9f11a5', s3_uuid='64e5723ed48041c19ad24370df7ef21c', parent_session_s3_uuid='2e43cb8308c149229946386ff503fb6e', multipart_upload_id='ReArTRsbzhSYILE4W.MvZEDHdss2_Qb..1bbih_OY4Ur1TbZtWpRNh6ZZNXaO4DMK0PF4FUEAGqCbRZwbaTjSe4nqtJTjMz6faH3WZ84VvH4NUCQ8gcL6G2x2FUXM2vPTsK1azQTOGnyHyYu.5_DDg--', status_change_log=[StatusChangeLog(status=<SessionStatus.SESSION_CREATED: 'session_created'>, timestamp=datetime.datetime(2025, 10, 7, 19, 43, 13, 521746, tzinfo=TzInfo(UTC))), StatusChangeLog(status=<SessionStatus.CALL_INITIATED: 'call_initiated'>, timestamp=datetime.datetime(2025, 10, 7, 19, 43, 15, 142562, tzinfo=TzInfo(UTC))), StatusChangeLog(status=<SessionStatus.CALL_IN_PROGRESS: 'call_in_progress'>, timestamp=datetime.datetime(2025, 10, 7, 19, 43, 21, 95791, tzinfo=TzInfo(UTC))), StatusChangeLog(status=<SessionStatus.CALL_DISCONNECTED: 'call_disconnected'>, timestamp=datetime.datetime(2025, 10, 7, 19, 46, 3, 919761, tzinfo=TzInfo(UTC)))], scoring_features=None, unlinked_parent_session_id=None, video_file_extension='mp4') with multipart_upload_id ReArTRsbzhSYILE4W.MvZEDHdss2_Qb..1bbih_OY4Ur1TbZtWpRNh6ZZNXaO4DMK0PF4FUEAGqCbRZwbaTjSe4nqtJTjMz6faH3WZ84VvH4NUCQ8gcL6G2x2FUXM2vPTsK1azQTOGnyHyYu.5_DDg-- PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.138504 78574 ai_interview_media_processing_service.py:55] 2318.95M Completed multipart upload for session 2e43cb8308c149229946386ff503fb6e PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.160801 78574 boto_utils.py:1270] 2318.95M Started downloading files from S3 to local path. Bucket: ef-video-interview-recording, File: interview-recordings/eightfolddemo-voice-screening.com/66412.mp4 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.341431 78574 boto_utils.py:1298] 2319.07M Downloaded and returning files from S3 to local path. Bucket: ef-video-interview-recording, File: interview-recordings/eightfolddemo-voice-screening.com/66412.mp4 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.341903 78574 ai_interview_media_processing_service.py:191] 2319.07M Successfully downloaded MP4 video for voice session 66412, size: 7.58 MB PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.342227 78574 boto_utils.py:1270] 2319.07M Started downloading files from S3 to local path. Bucket: vs-crawldata, File: ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.393940 78574 boto_utils.py:1298] 2319.07M Downloaded and returning files from S3 to local path. Bucket: vs-crawldata, File: ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.394511 78574 ai_interview_media_processing_service.py:236] 2319.07M Successfully downloaded audio for voice session 66412, size: 2.39 MB PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.394835 78574 merging_audio_and_video_service.py:64] 2319.07M Merging voice session 0 into merged_0.mp4... PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.395284 78574 os_utils.py:589] 2319.07M Running command: ['timeout', '-s', '9', '30', 'ffprobe', '-v', 'error', '-show_entries', 'format=duration', '-of', 'default=noprint_wrappers=1:nokey=1', '/tmp/interview_recordings_d5phjyhx/66412.mp4'] in directory: /home/ec2-user/vscode with timeout: 30 , env: None and shell: False PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.693646 78574 os_utils.py:607] 2319.07M Output for: timeout -s 9 30 ffprobe -v error -show_entries format=duration -of default=noprint_wrappers=1:nokey=1 /tmp/interview_recordings_d5phjyhx/66412.mp4
{"stdout": "158.301967\n", "stderr": "", "rc": 0} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.694916 78574 os_utils.py:589] 2319.07M Running command: ['timeout', '-s', '9', '30', 'ffprobe', '-v', 'error', '-show_entries', 'format=duration', '-of', 'default=noprint_wrappers=1:nokey=1', '/tmp/interview_recordings_d5phjyhx/66412.wav'] in directory: /home/ec2-user/vscode with timeout: 30 , env: None and shell: False PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.939255 78574 os_utils.py:607] 2319.07M Output for: timeout -s 9 30 ffprobe -v error -show_entries format=duration -of default=noprint_wrappers=1:nokey=1 /tmp/interview_recordings_d5phjyhx/66412.wav
{"stdout": "156.813063\n", "stderr": "", "rc": 0} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.940215 78574 merging_audio_and_video_service.py:96] 2319.07M Merge input durations - Video: 158.30s, Audio: 156.81s PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.940775 78574 utils.py:38] 2319.07M Executing Command: ffmpeg -loglevel error -i /tmp/interview_recordings_d5phjyhx/66412.mp4 -i /tmp/interview_recordings_d5phjyhx/66412.wav -map 0:v:0? -map 1:a:0? -c:v libx264 -preset fast -profile:v main -level 3.1 -pix_fmt yuv420p -r 25 -c:a aac -b:a 128k /tmp/interview_recordings_d5phjyhx/merged_0.mp4
 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:48:35.941101 78574 utils.py:40] 2319.07M Starting audio/video merge... PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:07.932115 78574 utils.py:49] 2319.07M Audio/video merge successful. PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:07.932999 78574 merging_audio_and_video_service.py:67] 2319.07M Successfully merged voice session 0, file size: 6.03 MB PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:07.933402 78574 merging_audio_and_video_service.py:43] 2319.07M Successfully processed voice session 1 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:07.933762 78574 ai_interview_media_processing_service.py:365] 2319.07M Concatenating 1 files into /tmp/interview_recordings_d5phjyhx/2e43cb8308c149229946386ff503fb6e_complete.mp4 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:07.951723 78574 concat_video_service.py:35] 2319.07M Copied single video to /tmp/interview_recordings_d5phjyhx/2e43cb8308c149229946386ff503fb6e_complete.mp4 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:07.952409 78574 ai_interview_media_processing_service.py:371] 2319.07M Successfully concatenated file, size: 6.03 MB PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.047723 78574 boto_utils.py:1049] 2319.2M Uploading file to s3://ef-video-interview-recording/interview-recordings/eightfolddemo-voice-screening.com/77215_complete.mp4 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.234752 78574 ai_interview_media_processing_service.py:336] 2321.07M Successfully uploaded concatenated recording to S3: ef-video-interview-recording/interview-recordings/eightfolddemo-voice-screening.com/77215_complete.mp4 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.242121 78574 ai_interview_media_processing_operation.py:41] 2321.07M Successfully processed recordings for session 2e43cb8308c149229946386ff503fb6e PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.243087 78574 ai_interview_media_processing_service.py:379] 2321.07M Combining interview audio files and saving to s3 for session feedback_form_template_id=92809 profile_id=473031799 position_id='27983252' group_id='eightfolddemo-voice-screening.com' interview_short_code='profile_screening' uce_id=4407605 slot_id='33e8' session_id='2e43cb8308c149229946386ff503fb6e' voice_session_id_list=['64e5723ed48041c19ad24370df7ef21c'] feedback_id='nNXV6VP8' interview_language='en' status=<InterviewStatus.INTERVIEW_COMPLETED: 'interview_completed'> additional_input='' created_ts=1759866107 last_updated_ts=1759866364 verified_phone_number=None agent_info={'name': 'Freshly created agent', 'type': <AI_AGENT_TYPE.INTERVIEWING: 'interviewing'>, 'email': 'air-freshly.created.agent@eightfolddemo-voice-screening.com', 'persona': {'id': 'iWq9tCtTw1SYmVpvsRjY', 'accent': 'indian', 'gender': 'female', 'language': 'en', 'avatar_url': 'https://static.vscdn.net/air-avatar-samples/language/en/female/indian/iWq9tCtTw1SYmVpvsRjY.png', 'preview_url': 'https://static.vscdn.net/air-voice-samples/iWq9tCtTw1SYmVpvsRjY.mp3'}} rds_id=77215 scoring_features=None status_change_log=[] link_expiry_timestamp=1760034599 interview_question_ids=None interview_mode='strict' interview_ready_for_completion=True unlinked_call_session_id_list=[] perform_speech_evaluation=False PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.372118 78574 concat_audio_service.py:47] 2321.07M Concatenating 1 audio files for interview session 2e43cb8308c149229946386ff503fb6e PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.372818 78574 concat_audio_service.py:62] 2321.07M Processing recording 1/1: ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.404391 78574 boto_utils.py:1256] 2321.07M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_recordings/eightfolddemo-voice-screening.com/66412.wav, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:08.850141 78574 boto_utils.py:1049] 2437.77M Uploading file to s3://vs-crawldata/ai_recruiter/concatenated_elevenlabs_recordings/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.075111 78574 boto_utils.py:1049] 2437.77M Uploading file to s3://vs-crawldata/ai_recruiter/concatenated_elevenlabs_recordings/eightfolddemo-voice-screening.com/77215.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.268230 78574 concat_audio_service.py:119] 2437.77M Uploaded concatenated audio ai_recruiter/concatenated_elevenlabs_recordings/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.wav, ai_recruiter/concatenated_elevenlabs_recordings/eightfolddemo-voice-screening.com/77215.wav PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.278747 78574 ai_interview_queueing_service.py:21] 2332.37M [AIInterviewQueueingService] Queueing ai_interview_feedback_generation_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.286244 78574 queue_utils.py:688] 2332.37M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_feedback_generation_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1542 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.287244 78574 boto_utils.py:587] 2332.37M Found sqs_queue test_nagrawal_queue in cache PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.311810 78574 queue_utils.py:727] 2332.37M Queued processor message id=4e38a293-2823-43ff-a1e6-5aa7820704ea operations=['ai_interview_feedback_generation_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.314395 78574 ai_interview_queueing_service.py:21] 2332.37M [AIInterviewQueueingService] Queueing ai_interview_activity_proctoring_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.316747 78574 queue_utils.py:688] 2332.37M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_activity_proctoring_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1534 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.317423 78574 boto_utils.py:587] 2332.37M Found sqs_queue test_nagrawal_queue in cache PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.351142 78574 queue_utils.py:727] 2332.37M Queued processor message id=85d7a56c-9949-4a9f-8ef2-9605e1b46100 operations=['ai_interview_activity_proctoring_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
W1007 19:49:09.351940 78574 worker.py:621] 2332.37M Op handler return falsy status: None {'operations': ['ai_interview_media_processing_operation'], '_traceback': '__EFCmPr-LZ4HC-B64::BCJNGGhAYgUAAAAAAACROAIAAPNCICBGaWxlICIvaG9tZS9lYzItdXNlci92c2NvZGUvd3d3L3Byb2Nlc3Nvci9xdWV1ZV91dGlscy5weSIsIGxpbmUgNTgwLCBpbiBhZGRfdG9fLwBBaW5nXzAA8xQKICAgIHBheWxvYWRbJ190cmFjZWJhY2snXSA9IHRocmVhZFMA/w5jdXJyZW50X3N0YWNrKGNvbXByZXNzPVRydWUpCqgAD/AGYWlfaW50ZXJ2aWV3L2NvbW1vbi9zDwA5Y2VzHQACmAAAoQADHwAHzQAhNzfMAALqAAk1AFhtZWRpYd4AkW9wZXJhdGlvbuIACBwBDwoBBC8oCm0BGUpwb3N0ggBPY2FsbIEAAgiNARE1wABSaGFuZGx7AQ36AAj5AA/oABovKCnBABpnd29ya2VynAAiNjGdAAMjAHJfbWVzc2FnpgCScmV0ID0gb3AuugDzCChyZXF1ZXN0LCBjdHhfYWZ0ZXJfcHJlOgBCLCBlZlMBD5IALDEzMjGSAAGFAjRhbmT3AAGTAAunABMoCAAGfQAiLCBRAFNfY3R4LAECV2dyb3Vw/QEPoQAsLzEwoQADEl8nAWVfZXhjZXCEAgwmABEolAAicz0HAAivAB49ugD/B3JlY2VpdmVfd2FpdF90aW1lX21hcD0cAAgAmQDJc3RhbmNlX3R5cGU9DgAP+AAsMTg1OfgAPm1hadsADwEBAh4o5QAvLCC+AAoPsAA6EjeoAYE8bW9kdWxlPrQAcG1haW4oKQoAAAAA', '_parent_msg_id': '439cef36-4329-4069-8a56-4799af17bae7', '_parent_trace_id': 'b2f95ca9fa6a44949f3afd868f08a9df', '_message_dispatched_ts': 1759866498.0663254, '_dispatch_host': '172.31.27.172', '_queue_name': 'ai_interview_op_queue', '_parent_queue_name': 'test_nagrawal_queue', '_interceptor_stack': [], '_workflow_recipe_ids': [], '_db_access_override_group_id': None, 'current_user': 'air-freshly.created.agent@eightfolddemo-voice-screening.com', 'group_id': 'eightfolddemo-voice-screening.com', 'workflow_recipe_id': None, 'admin_email': None, 'commit_immediately': True, 'db': 'prod_slave', 'rds_id': 77215} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.353346 78574 queue_utils.py:212] 2332.37M Deleting message 4d868914-7a04-45e4-aba1-31cf14de73af PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.363135 78574 worker.py:747] 2332.37M [OpLevelPerfStats] Op: ai_interview_media_processing_operation. Performance Stats: {'CPUTime': 0, 'BlockingTime': 0, 'NonPatchedBlockingTime': 0, 'WallClockTime': 35.390583992004395, 'WaitTime': 35.390583992004395, 'TotalEventIOTime': 0.095, 'RSSMemUsed': 'NA'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.364110 78574 request_tracelog.py:307] 2332.37M processor_test_nagrawal_queue: Total latency ms: 35391, Event latency ms: 1325, Num events: 21, Mem used: 21 MB, (Event, count, latency ms): [['ai_interview_media_processing_operation', {'num': 1, 'total_ms': 35360}], ['upload_to_s3', {'num': 5, 'total_ms': 832}], ['s3_download_to_local_path', {'num': 2, 'total_ms': 233}], ['download_from_s3', {'num': 3, 'total_ms': 82}], ['sqs_queue', {'num': 2, 'total_ms': 64}], ['ef_queue_send_message', {'num': 2, 'total_ms': 54}], ['prod_db_read', {'num': 11, 'total_ms': 24}], ['prod_db_read_interview_session', {'num': 6, 'total_ms': 14}], ['cloud_interfaces_get_queue', {'num': 1, 'total_ms': 14}], ['redis.get', {'num': 6, 'total_ms': 10}]], Slowest 3 events [{'idx': 13, 'event': 'ai_interview_media_processing_operation', 'latency_ms': 35360.1, 'extra': '{"operations": ["ai_interview_media_processing_operation"], "_traceback": "truncated", "_parent_msg_id": "439cef36-4329-4069-8a56-4799af17bae7", "_parent_trace_id": "b2f95ca9fa6a44949f3afd868f08a9df", "_message_dispatched_ts": 1759866498.0663254, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "air-freshly.created.agent@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "commit_immediately": true, "db": "prod_slave", "rds_id": 77215}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'upload_to_s3', 'latency_ms': 832, 'extra': {'num': 5}}, {'idx': -1, 'event': 's3_download_to_local_path', 'latency_ms': 233, 'extra': {'num': 2}}] PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.364948 78574 worker.py:759] 2332.37M Ending processing of message 4d868914-7a04-45e4-aba1-31cf14de73af latency: 35.40312480926514 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 4d868914-7a04-45e4-aba1-31cf14de73af
I1007 19:49:09.368772 78574 worker.py:477] 2332.37M Starting processing of message 27138ec2-5e02-4372-ac01-14423a6d7038 received at 2025-10-07 19:48:18.000000 with timeout at 2025-10-07 20:18:18.000000
I1007 19:49:09.388928 78574 request_tracelog.py:76] 2332.37M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: True and mem_profile: True
I1007 19:49:09.405987 78574 worker.py:579] 2332.37M TimeToStart for first op ai_interview_eval_operation is: 51. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 4, 'total_ms': 5}], ['redis.set', {'num': 1, 'total_ms': 3}], ['redis.pipeline', {'num': 1, 'total_ms': 1}]]. PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.406725 78574 worker.py:598] 2332.37M Invoking preprocess for ai_interview_eval_operation op PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.407152 78574 worker.py:603] 2332.37M Invoking handle for ai_interview_eval_operation op PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.413852 78574 ai_interview_eval_operation.py:36] 2332.37M Triggering Interviewer Evaluation for group_id: eightfolddemo-voice-screening.com, interview session: 77215 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.440483 78574 boto_utils.py:1256] 2332.37M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.475816 78574 boto_utils.py:1256] 2332.37M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.642908 78574 boto_utils.py:1256] 2332.5M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.790485 78574 search_server.py:572] 2332.62M profile_feedback_search:eightfolddemo-voice-screening.com:interview_feedback_recommended_skills cachekeys: ['-5349372282915102410:-7509636809743807679'] solr_args: expandMacros=False&_callerid=interview_feedback_recommended_skills&sort=profile_feedback.t_update desc&wt=json&q=group_id:"eightfolddemo-voice-screening.com"&fq=['profile_feedback.reviewer_email:"import@eightfolddemo-voice-screening.com"', 'group_id:"eightfolddemo-voice-screening.com"']&fl=id,group_id,sort_score:profile_feedback.t_update&defType=edismax&start=0&rows=10&_rows_post_merge=10&facet=true&facet.field=['profile_feedback.skills_rating']&facet.limit=10&facet.threads=2&facet.mincount=1 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.836467 78574 boto_utils.py:1270] 2332.62M Started downloading files from S3 to local path. Bucket: vs-model-training, File: air_eval/interview_templates/92809_5d1380662063d58ba30a5268cf43ffcf523756cee03aaab354663c2a.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.878488 78574 boto_utils.py:1298] 2332.62M Downloaded and returning files from S3 to local path. Bucket: vs-model-training, File: air_eval/interview_templates/92809_5d1380662063d58ba30a5268cf43ffcf523756cee03aaab354663c2a.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:09.940104 78574 llm_router.py:71] 2332.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:14.934346 78574 _client.py:1038] 2332.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
W1007 19:49:14.948035 78574 request_tracelog.py:152] 2332.62M Really slow event get_chat_completion.get_completion_raw latency:5.002 {'caller_id': 'ai_interview_eval', 'truncated_prompt': [{'role': 'system', 'content': '\n    You are an expert interview evaluator. Given a transcript of an interview, determine the following metadata:\n\n    1. Is it a proper interview call or only a trial kind of call to test out the AI interviewer\n    2. Who initiated the call end - interviewer or candidate\n    3. Reason for call end\n    4. Name of the candidate, as used in the transcript\n    5. Name of the interviewer, as used in the transcript\n\n    ### 1. Interview Type Classification\n    **Objective:** Distinguish between proper real interviews and test runs or trial calls\n    **Indicators of Trial Call:**\n    - Explicit mentions of "test," "practice," or "demo"\n    - Candidate asks about system functionality ("How do I retry answers?")\n    - Contains placeholder content ("[TEST SCRIPT]") or nonsensical responses\n    - Unusually short duration with no substantive questions\n    - Candidate stalling or not answering the questions\n\n    **Indicators of Real Interview:**\n    - Detailed job-specific questions ("Tell me about your experience with Python")\n    - Behavioral assessment ("Describe a time you handled conflict")\n    - Candidate provides personal career details\n    - Follows structured interview phases (introduction -> technical questions -> closing)\n    - Candidate provides relevant answers to the questions\n\n    **Edge Cases:**\n    - If transcript contains both real questions and test elements -> classify as trial\n    - If candidate mentions "practice" but discusses real experience -> flag as ambiguous with explanation\n\n    *Example 1 (Trial):*\n    AI: "This is a practice session. Please say \'orange\' to test audio."\n    -> Clear trial marker\n\n    *Example 2 (Ambiguous):*\n    Candidate: "I want to try the real interview system" then answers properly\n    -> Classify as real interview with note about dual purpose\n\n    *Example 3 (Real):*\n    1. Interviewer: Hello, how are you today? Can you tell me about yourself?\n    2. Candidate: I\'m doing well. I\'m a software engineer with 5 years of experience.\n    3. Interviewer: What is your relevant number of years of experience for this role?\n    4. Candidate: I have 5 years of experience in software engineering.\n    -> Classify as real since candidate is providing relevant answers and personal career details.\n\n    *Example 4 (Trial):*\n    1. Interviewer: Hi Divya, I am Eric, an AI recruiter, how are you doing today?\n    2. Candidate: I\'m doing good.\n    3. Interviewer: Thank you for asking, I\'m here and ready to assist you with this interview. Let\'s dive into the details.\n    4. Candidate: Hello?\n    5. Interviewer: Can you tell me about yourself?\n    6. Candidate: Mm-hmm.\n    -> Classify as trial since candidate is not providing relevant answers and seems to be stalling.\n\n    ### 2. Call End Initiator\n    **Methodology:**\n    - For each turn, figure out if the call end or conversation end has been initiated or not\n    - The call end intiator is whoever requests/implies the end of the call first\n\n    **Edge Case Protocol:**\n    - Mutual farewells ("Thanks! -> You too!") -> Credit to initiator\n    - Technical disconnections -> Specify "System failure" in reason field\n    - Abrupt endings mid-sentence -> Note "Unclear ending" with transcript excerpt\n\n    *Example:*\n    AI: "Any final questions?"\n    Candidate: "No, I-" [transcript ends]\n    -> Ender: System/Technical | Reason: Abrupt termination\n\n    ### 3. Call End Reasoning\n    **Categorization Framework:**\n\n    | Category | Subtypes | Verification Triggers |\n    |----------|----------|-----------------------|\n    | Natural Completion | All questions answered | AI closing script |\n    | Technical Issues | Audio loss, freezing | "Can you hear me?" |\n    | Candidate Withdrawal | "I withdraw", sudden exit | Emotional language |\n    | System Policy | Time limits, violations | "Session will time out" |\n    | Ambiguous | Unclear context | No decisive evidence |\n\n    **Priority Order:** Technical Issues > Withdrawal > System Policy > Natural Completion\n\n    ### **4. Participant Identification**\n    **Protocol for Names:**\n    1. **AI Identification:**\n    - Look for self-introductions: "I\'m Ana, your AI interviewer"\n    - Search for signature phrases before questions\n    - Default: "Unknown" if unspecified\n\n    2. **Candidate Identification:**\n    - Greeting exchanges: "Hi, I\'m John Doe"\n    - Email/username patterns: john.doe@domain.com -> "John Doe"\n    - If unavailable: "Unknown"\n\n    **Edge Cases:**\n    - Multiple names used -> Use first mentioned valid name\n    - Nicknames ("Call me Liz") -> Parenthetical notation: Elizabeth (Liz)\n    - Non-Western names -> Preserve original formatting (e.g., Xiaóyí NOT Xiao Yi)\n\n    *Example Transcript Excerpt:*\n    AI: "Welcome to SmartHire, I\'m InterviewBot v2.3"\n    Candidate: "My names\'s Dr. Emily Rodríguez-Smith, PhD"\n    -> AI: InterviewBot v2.3 | Candidate: Dr. Emily Rodríguez-Smith\n\n    ### Output Format\n    ```json\n    {\n        "interview_type": {\n            "classification": "real/trial/ambiguous",\n            "confidence_score": 1-5,\n            "evidence": ["excerpt1", "excerpt2"]\n        },\n        "termination": {\n            "initiator": "AI/Candidate/System/Unclear",\n            "reason": {\n                "primary": "Technical/Natural/Withdrawal/etc",\n                "details": "Specific explanation"\n            }\n        },\n        "candidate_name": "string",\n        "interviewer_name": "string"\n    }\n    ```\n\n    Output only the JSON as per the format above, nothing else\n\n    ### **Validation Protocol**\n    1. Cross-check names across entire transcript\n    2. Verify termination reason against time markers (sudden end at 00:03:22 suggests technical)\n    3. Conflict resolution: If AI says goodbye but candidate stopped responding earlier -> actual ender = candidate\n    4. Confidence scoring:\n    5 = Multiple clear indicators\n    3 = Single indicator with supporting context\n    1 = Pure speculation\n\n    ### Training Examples\n    **Sample Input 1:**\n    1. Interviewer: "TESTING AUDIO INPUT - Please state your favorite color"\n    2. Candidate: "Blue"\n    3. Interviewer: [Transcript ends abruptly]\n\n    **Output 1:**\n    ```json\n    {\n        "interview_type": {\n            "classification": "trial",\n            "confidence_score": 5,\n            "evidence": ["TESTING AUDIO INPUT"]\n        },\n        "termination": {\n            "initiator": "System",\n            "reason": {"primary": "Technical", "details": "Abrupt ending after test question"},\n        },\n        "candidate_name": "Unknown",\n        "interviewer_name": "Unknown"\n    }\n    ```\n\n    **Sample Input 2:**\n    1. Interviewer: "Thanks for your time today, Michael"\n    2. Candidate: "Thank you! I\'ll await next steps."\n    3. Interviewer: "Goodbye!"\n    4. [Connection closed]\n\n    **Output 2:**\n    ```json\n    {\n        "interview_type": {\n            "classification": "real",\n            "confidence_score": 5,\n            "evidence": ["next steps reference"]\n        },\n        "termination": {\n            "initiator": "AI",\n            "reason": {"primary": "Natural", "details": "Standard closing sequence"},\n        },\n        "candidate_name": "Michael",\n        "interviewer_name": "Unknown"\n    }\n    ```\n    '}, {'role': 'user', 'content': " Transcript: 1. Interviewer: Hi Rachel, I am Freshly created agent, an AI recruiter, how are you doing today?\n2. Candidate: I'm doing great, how are you?\n3. Interviewer: I am functioning as expected, thank you for asking. I am reaching out to you regarding the Fullstack Developer position. This role involves developing and maintaining web applications across both front-end and back-end frameworks, with a focus on JavaScript, HTML, CSS, React or Angular, and Node.js or similar technologies. You will also be expected to collaborate with a team and work in an agile environment. Before we begin, please note that feedback will be shared with you in two days. If you are ready, I will start with the interview questions shortly. Are you prepared to proceed?\n4. Candidate: Yes, I am.\n5. Interviewer: Alright. What got you interested in applying for this Fullstack Developer role with us?\n6. Candidate: The company is doing a great job. The mission statement aligns with what I stand for and my skills will help your company grow.\n7. Interviewer: Okay. Where do you see your career heading in the next few years?\n8. Candidate: I want to become a staff engineer or a principal engineer in the next five years.\n9. Interviewer: Got it. Can you tell me what you are expecting in terms of compensation for this role?\n10. Candidate: 150,000 US dollars per annum.\n11. Interviewer: Okay. That covers all the questions I had for you today. Do you have any questions for me or is there anything else you would like to discuss before we end the call?\n12. Candidate: In 20 words or less, please explain the responsibilities I have.\n13. Interviewer: Your responsibilities include developing and maintaining web applications, working on both front-end and back-end, and collaborating with the team. Is there anything else you would like to ask?\n14. Candidate: Nothing at all.\n15. Interviewer: Have a great day!\n\n    Output:"}], 'prompt_tokens': 2114, 'completion_tokens': 163, 'model': 'gpt-4.1'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:14.951227 78574 main.py:252] 2332.62M No voice eval transcripts found. Skipping voice metrics PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:14.951554 78574 main.py:290] 2332.62M This is flagged as improper interview group_id:eightfolddemo-voice-screening.com,  session_id: 2e43cb8308c149229946386ff503fb6e PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:14.951841 78574 main.py:258] 2332.62M Evaluating Metric: personal_information_compliance_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:15.009582 78574 llm_router.py:71] 2332.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:15.096630 78574 llm_router.py:71] 2332.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:15.167177 78574 llm_router.py:71] 2332.75M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:15.226079 78574 llm_router.py:71] 2332.75M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.045241 78574 _client.py:1038] 2332.75M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.047619 78574 _client.py:1038] 2332.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.566537 78574 llm_router.py:71] 2392.74M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.568333 78574 _client.py:1038] 2392.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.569784 78574 _client.py:1038] 2392.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.637058 78574 llm_router.py:71] 2393.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.690713 78574 llm_router.py:71] 2394.49M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:16.748937 78574 llm_router.py:71] 2395.37M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:17.469630 78574 _client.py:1038] 2395.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:17.581476 78574 _client.py:1038] 2395.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:17.593032 78574 firehose_utils.py:98] 2395.74M Publishing processor_event_log to firehose with 12 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:17.736059 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:17.859745 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:20.140949 78574 main.py:258] 2395.87M Evaluating Metric: interviewer_comprehension_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:20.206284 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:20.261690 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:20.315377 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:20.381925 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:21.862457 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:21.936035 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:21.937918 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:21.942555 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:22.020800 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:22.083124 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:23.339179 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:23.539853 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:23.567602 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:23.854042 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:25.853625 78574 main.py:258] 2395.87M Evaluating Metric: interview_top_level_question_coverage_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:25.910880 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:27.669562 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:27.742592 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:29.443216 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:29.523628 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:31.001296 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:33.455099 78574 main.py:258] 2395.87M Evaluating Metric: interview_mandatory_questions_coverage_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:33.561445 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:33.634607 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:33.704511 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.620647 78574 main.py:258] 2395.87M Evaluating Metric: valid_resume_experience_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.676736 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.734698 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.788311 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.844649 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.846455 78574 firehose_utils.py:98] 2395.87M Publishing services_api_log to firehose with 41 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:35.848765 78574 firehose_utils.py:98] 2395.87M Publishing ai_interview_rag_eval_log to firehose with 1 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:37.379436 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:37.389312 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:37.462171 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:37.524883 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:37.835545 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:37.970885 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:38.721761 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:38.827578 78574 llm_router.py:71] 2395.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:39.144720 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:39.342011 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:39.851206 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:40.298834 78574 _client.py:1038] 2395.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:42.318782 78574 main.py:258] 2395.87M Evaluating Metric: interview_administrative_questions_coverage_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:44.769046 78574 main.py:258] 2395.87M Evaluating Metric: message_operation_stats PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:47.260007 78574 main.py:258] 2421.87M Evaluating Metric: question_duplication_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:47.319197 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:53.631487 78574 _client.py:1038] 2421.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
W1007 19:49:53.662883 78574 request_tracelog.py:152] 2421.87M Really slow event get_chat_completion.get_completion_raw latency:6.337 {'caller_id': 'ai_interview_eval', 'truncated_prompt': [{'role': 'system', 'content': '\n        You are an expert recruiter skilled at evaluating interview transcripts.\n\n        ### Task:\n        1. Identify duplicate questions in a numbered list representing an interview transcript.\n        2. For each duplicate question, specify the number and text of the most recent previous question it duplicates.\n        3. Maintain a "context stack" that updates with each question. Track:\n            - Companies/Projects (e.g., "Company X", "Project Y")\n            - Topics (e.g., "large-scale e-commerce app", "OOP with Java")\n            - Projects (e.g., "Scalable E-Commerce Website")\n        4. For each NEW question:\n            a) Update context stack based on keywords/pronouns:\n                - "Here"/"this" = Last mentioned company/project/topic\n                - New named entities reset context (e.g., "Company Z")\n            b) Compare to ALL prior questions:\n                - If SAME/SIMILAR expected answer + SAME context stack → Duplicate\n                - If SAME/SIMILAR wording + DIFFERENT context → NOT duplicate\n\n        ### Key Guidelines:\n        - **Context Matters**: A question is **only a duplicate** if both the expected answer is same/similar **and** the underlying context (e.g., company, project, experience) is the same.\n        - Example 1:\n            1. Interviewer: What was your biggest challenge at [Company X]?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What was your biggest challenge at [Company Y]?\n            → turn 1 and turn 3 are not duplicates (different context).\n        - Example 2:\n            1. Interviewer: What was your biggest challenge at [Company X]?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What was the most challenging part of your role at [Company X]?\n            → turn 1 and turn 3 are duplicate (same context, same/similar expected answer).\n        - Example 3:\n            1. Interviewer: How would you describe your expertise?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What are your areas of technical expertise?\n            → turn 1 and turn 3 are duplicate (same/similar expected answer, no special context).\n\n        - **Non-Duplicate Scenarios**:\n        - Pronouns (e.g., "here," "this") refer to **new contexts** from intervening questions.\n        - Example 1:\n            1. Interviewer: What department did you work in at [Company X]?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What was your biggest challenge there?\n            4. Candidate: I worked on many challenging projects at [Company X].\n            5. Interviewer: Why did you leave [Company Y]?\n            6. Candidate: I was offered a better role elsewhere.\n            7. Interviewer: What was your biggest challenge there?\n            → turn 7 refers to Company Y (due to 5), so **not** a duplicate of turn 5.\n\n        ## Output Format:\n        Your output needs to be a JSON list of objects, each containing information about a question:\n        ```json\n        [\n            ...\n            {\n                "turn_number": "Turn number of the question",\n                "question": "Question text, verbatim",\n                "context": ["Context stack"],\n                "duplicate_of_turn_number": "If the question is duplicated, turn number of the question it duplicates, otherwise 0",\n                "duplicate_of_question_text": "If the question is duplicated, question text of the question it duplicates, otherwise """\n                "was_repetition_required": "true if the question is a repetition requested by the candidate or the interviewer had to repeat because the candidate was unable to understand the question, otherwise false"\n            }\n            ...\n        ]\n\n        ### Example Output:\n        ```json\n        [\n            {\n                "turn_number": 3,\n                "question": "What is your name?",\n                "context": [],\n                "duplicate_of_turn_number": 0,\n                "duplicate_of_question_text": "",\n                "was_repetition_required": false\n            },\n            ...\n            {\n                "turn_number": 7,\n                "question": "What was the biggest challenge you faced there?",\n                "context": ["Google"],\n                "duplicate_of_turn_number": 3,\n                "duplicate_of_question_text": "What was the most challenging part of your role at Google?",\n                "was_repetition_required": false\n            },\n        ]\n        ```\n\n        Follow the above format strictly and output nothing else.\n        '}, {'role': 'user', 'content': '\n        You are an expert recruiter skilled at evaluating interview transcripts.\n\n        ### Task:\n        1. Identify duplicate questions in a numbered list representing an interview transcript.\n        2. For each duplicate question, specify the number and text of the most recent previous question it duplicates.\n        3. Maintain a "context stack" that updates with each question. Track:\n            - Companies/Projects (e.g., "Company X", "Project Y")\n            - Topics (e.g., "large-scale e-commerce app", "OOP with Java")\n            - Projects (e.g., "Scalable E-Commerce Website")\n        4. For each NEW question:\n            a) Update context stack based on keywords/pronouns:\n                - "Here"/"this" = Last mentioned company/project/topic\n                - New named entities reset context (e.g., "Company Z")\n            b) Compare to ALL prior questions:\n                - If SAME/SIMILAR expected answer + SAME context stack → Duplicate\n                - If SAME/SIMILAR wording + DIFFERENT context → NOT duplicate\n\n        ### Key Guidelines:\n        - **Context Matters**: A question is **only a duplicate** if both the expected answer is same/similar **and** the underlying context (e.g., company, project, experience) is the same.\n        - Example 1:\n            1. Interviewer: What was your biggest challenge at [Company X]?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What was your biggest challenge at [Company Y]?\n            → turn 1 and turn 3 are not duplicates (different context).\n        - Example 2:\n            1. Interviewer: What was your biggest challenge at [Company X]?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What was the most challenging part of your role at [Company X]?\n            → turn 1 and turn 3 are duplicate (same context, same/similar expected answer).\n        - Example 3:\n            1. Interviewer: How would you describe your expertise?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What are your areas of technical expertise?\n            → turn 1 and turn 3 are duplicate (same/similar expected answer, no special context).\n\n        - **Non-Duplicate Scenarios**:\n        - Pronouns (e.g., "here," "this") refer to **new contexts** from intervening questions.\n        - Example 1:\n            1. Interviewer: What department did you work in at [Company X]?\n            2. Candidate: I worked as a Software Engineer at [Company X].\n            3. Interviewer: What was your biggest challenge there?\n            4. Candidate: I worked on many challenging projects at [Company X].\n            5. Interviewer: Why did you leave [Company Y]?\n            6. Candidate: I was offered a better role elsewhere.\n            7. Interviewer: What was your biggest challenge there?\n            → turn 7 refers to Company Y (due to 5), so **not** a duplicate of turn 5.\n\n        ## Output Format:\n        Your output needs to be a JSON list of objects, each containing information about a question:\n        ```json\n        [\n            ...\n            {\n                "turn_number": "Turn number of the question",\n                "question": "Question text, verbatim",\n                "context": ["Context stack"],\n                "duplicate_of_turn_number": "If the question is duplicated, turn number of the question it duplicates, otherwise 0",\n                "duplicate_of_question_text": "If the question is duplicated, question text of the question it duplicates, otherwise """\n                "was_repetition_required": "true if the question is a repetition requested by the candidate or the interviewer had to repeat because the candidate was unable to understand the question, otherwise false"\n            }\n            ...\n        ]\n\n        ### Example Output:\n        ```json\n        [\n            {\n                "turn_number": 3,\n                "question": "What is your name?",\n                "context": [],\n                "duplicate_of_turn_number": 0,\n                "duplicate_of_question_text": "",\n                "was_repetition_required": false\n            },\n            ...\n            {\n                "turn_number": 7,\n                "question": "What was the biggest challenge you faced there?",\n                "context": ["Google"],\n                "duplicate_of_turn_number": 3,\n                "duplicate_of_question_text": "What was the most challenging part of your role at Google?",\n                "was_repetition_required": false\n            },\n        ]\n        ```\n\n        Follow the above format strictly and output nothing else.\n        '}, {'role': 'user', 'content': "\n\nBelow is the interview transcript:\n1. Interviewer: Hi Rachel, I am Freshly created agent, an AI recruiter, how are you doing today?\n2. Candidate: I'm doing great, how are you?\n3. Interviewer: I am functioning as expected, thank you for asking. I am reaching out to you regarding the Fullstack Developer position. This role involves developing and maintaining web applications across both front-end and back-end frameworks, with a focus on JavaScript, HTML, CSS, React or Angular, and Node.js or similar technologies. You will also be expected to collaborate with a team and work in an agile environment. Before we begin, please note that feedback will be shared with you in two days. If you are ready, I will start with the interview questions shortly. Are you prepared to proceed?\n4. Candidate: Yes, I am.\n5. Interviewer: Alright. What got you interested in applying for this Fullstack Developer role with us?\n6. Candidate: The company is doing a great job. The mission statement aligns with what I stand for and my skills will help your company grow.\n7. Interviewer: Okay. Where do you see your career heading in the next few years?\n8. Candidate: I want to become a staff engineer or a principal engineer in the next five years.\n9. Interviewer: Got it. Can you tell me what you are expecting in terms of compensation for this role?\n10. Candidate: 150,000 US dollars per annum.\n11. Interviewer: Okay. That covers all the questions I had for you today. Do you have any questions for me or is there anything else you would like to discuss before we end the call?\n12. Candidate: In 20 words or less, please explain the responsibilities I have.\n13. Interviewer: Your responsibilities include developing and maintaining web applications, working on both front-end and back-end, and collaborating with the team. Is there anything else you would like to ask?\n14. Candidate: Nothing at all.\n15. Interviewer: Have a great day!\n"}], 'prompt_tokens': 2433, 'completion_tokens': 497, 'model': 'gpt-4.1-mini'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:55.632009 78574 main.py:258] 2421.87M Evaluating Metric: question_clarity_and_phrasing_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:49:55.684999 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:15.790733 78574 _client.py:1038] 2421.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:15.802394 78574 firehose_utils.py:98] 2421.87M Publishing gpt_query_log to firehose with 28 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
W1007 19:50:15.962420 78574 request_tracelog.py:152] 2421.87M Really slow event get_chat_completion.get_completion_raw latency:20.105 {'caller_id': 'ai_interview_eval', 'truncated_prompt': [{'role': 'system', 'content': '\n        You are an expert interview analyst. Your task is to evaluate every question asked by an interviewer in a transcript for **clarity** and **simplicity**. Use a structured, criteria-driven approach.\n\n        ## Task\n        For **each question** in the transcript:\n        1. **Tokenize the question**: Break it into clauses and identify key terms.\n        2. **Analyze using the criteria below**.\n        3. **Score each criterion (1-5)** and provide fixes.\n        4. **Rewrite the question** to resolve flagged issues.\n\n\n        ## Evaluation Criteria\n        ### 1. Ambiguity Check\n        - **Checks**:\n        - **Vague terms**: Flag words like "efficient," "scalable," "handle," or "situation" without context.\n        - **Structural issues**: Double-barreled questions, unclear pronouns (e.g., "they," "it").\n        - **Interpretations**: Generate 2-3 possible meanings of the question.\n        - **Score**:\n        1- 1 = Multiple ambiguous terms/structures. Candidate is unable to answer the question regardless of ability.\n        - 5 = No ambiguity.\n\n        ### 2. Complexity Check\n        - **Checks**:\n        - **Readability**: Flag passive voice, sentences >20 words, or Flesch-Kincaid grade >12.\n        - **Jargon**: Identify unexplained technical terms (e.g., "idempotency," "NLU pipeline").\n        - **Rewriting**: Simplify the question and compare to the original.\n        - **Score**:\n        - 1 = Confusing phrasing or excessive jargon. The question could be rephrased to be a lot more clear and concise.\n        - 5 = Clear and concise.\n\n        ## Output Format\n        For each question, provide a JSON object (inside a JSON list) in the following format:\n        ```json\n        [\n            {\n                "question": "Exact text",\n                "ambiguity": {\n                    "score": 0, // 1-5\n                    "issues": ["List of vague terms/structures", "possible interpretations"],\n                    "fix": "Replace vague terms or split compound questions"\n                },\n                "complexity": {\n                    "score": 0, // 1-5\n                    "issues": ["Jargon", "passive voice", "long sentences"],\n                    "fix": "Simplified version"\n                },\n                "rewritten_question": "Improved version combining all fixes"\n                "summary": {\n                    "issues": ["Recurring issues and patterns"],\n                }\n            }\n        ]\n        ```\n\n        ### Example Output\n        ```json\n        [\n            {\n                "question": "Can you walk me through how you\'d optimize a process with conflicting dependencies?",\n                "ambiguity": {\n                    "score": 2,\n                    "issues": [\n                        "Optimize (cost, speed, or reliability?)",\n                        "conflicting dependencies (technical vs. team conflicts)"\n                    ],\n                    "fix": "Specify \'optimize for speed\' and clarify dependencies (e.g., \'software library conflicts\')"\n                },\n                "complexity": {\n                    "score": 3,\n                    "issues": [\n                        "Abstract phrasing (\'walk me through\', \'process\')"\n                    ],\n                    "fix": "Describe steps to resolve software library conflicts"\n                },\n                "rewritten_question": "How do you resolve version conflicts in JavaScript packages to speed up a project?",\n                "summary": {\n                    "issues": [\n                        "Overly abstract questions mismatched with entry-level expertise",\n                        "Questions assume familiarity with systems engineering, not web development"\n                    ],\n                }\n            }\n        ]\n        ```\n        Output only the JSON list with required objects in the above format, nothing else.\n        '}, {'role': 'user', 'content': '\n        You are an expert interview analyst. Your task is to evaluate every question asked by an interviewer in a transcript for **clarity** and **simplicity**. Use a structured, criteria-driven approach.\n\n        ## Task\n        For **each question** in the transcript:\n        1. **Tokenize the question**: Break it into clauses and identify key terms.\n        2. **Analyze using the criteria below**.\n        3. **Score each criterion (1-5)** and provide fixes.\n        4. **Rewrite the question** to resolve flagged issues.\n\n\n        ## Evaluation Criteria\n        ### 1. Ambiguity Check\n        - **Checks**:\n        - **Vague terms**: Flag words like "efficient," "scalable," "handle," or "situation" without context.\n        - **Structural issues**: Double-barreled questions, unclear pronouns (e.g., "they," "it").\n        - **Interpretations**: Generate 2-3 possible meanings of the question.\n        - **Score**:\n        1- 1 = Multiple ambiguous terms/structures. Candidate is unable to answer the question regardless of ability.\n        - 5 = No ambiguity.\n\n        ### 2. Complexity Check\n        - **Checks**:\n        - **Readability**: Flag passive voice, sentences >20 words, or Flesch-Kincaid grade >12.\n        - **Jargon**: Identify unexplained technical terms (e.g., "idempotency," "NLU pipeline").\n        - **Rewriting**: Simplify the question and compare to the original.\n        - **Score**:\n        - 1 = Confusing phrasing or excessive jargon. The question could be rephrased to be a lot more clear and concise.\n        - 5 = Clear and concise.\n\n        ## Output Format\n        For each question, provide a JSON object (inside a JSON list) in the following format:\n        ```json\n        [\n            {\n                "question": "Exact text",\n                "ambiguity": {\n                    "score": 0, // 1-5\n                    "issues": ["List of vague terms/structures", "possible interpretations"],\n                    "fix": "Replace vague terms or split compound questions"\n                },\n                "complexity": {\n                    "score": 0, // 1-5\n                    "issues": ["Jargon", "passive voice", "long sentences"],\n                    "fix": "Simplified version"\n                },\n                "rewritten_question": "Improved version combining all fixes"\n                "summary": {\n                    "issues": ["Recurring issues and patterns"],\n                }\n            }\n        ]\n        ```\n\n        ### Example Output\n        ```json\n        [\n            {\n                "question": "Can you walk me through how you\'d optimize a process with conflicting dependencies?",\n                "ambiguity": {\n                    "score": 2,\n                    "issues": [\n                        "Optimize (cost, speed, or reliability?)",\n                        "conflicting dependencies (technical vs. team conflicts)"\n                    ],\n                    "fix": "Specify \'optimize for speed\' and clarify dependencies (e.g., \'software library conflicts\')"\n                },\n                "complexity": {\n                    "score": 3,\n                    "issues": [\n                        "Abstract phrasing (\'walk me through\', \'process\')"\n                    ],\n                    "fix": "Describe steps to resolve software library conflicts"\n                },\n                "rewritten_question": "How do you resolve version conflicts in JavaScript packages to speed up a project?",\n                "summary": {\n                    "issues": [\n                        "Overly abstract questions mismatched with entry-level expertise",\n                        "Questions assume familiarity with systems engineering, not web development"\n                    ],\n                }\n            }\n        ]\n        ```\n        Output only the JSON list with required objects in the above format, nothing else.\n        '}, {'role': 'user', 'content': '\n\nBelow is the list of questions:\n1. Hi Rachel, I am Freshly created agent, an AI recruiter, how are you doing today? \n2. I am functioning as expected, thank you for asking. I am reaching out to you regarding the Fullstack Developer position. This role involves developing and maintaining web applications across both front-end and back-end frameworks, with a focus on JavaScript, HTML, CSS, React or Angular, and Node.js or similar technologies. You will also be expected to collaborate with a team and work in an agile environment. Before we begin, please note that feedback will be shared with you in two days. If you are ready, I will start with the interview questions shortly. Are you prepared to proceed?\n3. Alright. What got you interested in applying for this Fullstack Developer role with us?\n4. Okay. Where do you see your career heading in the next few years?\n5. Got it. Can you tell me what you are expecting in terms of compensation for this role?\n6. Okay. That covers all the questions I had for you today. Do you have any questions for me or is there anything else you would like to discuss before we end the call?\n7. Your responsibilities include developing and maintaining web applications, working on both front-end and back-end, and collaborating with the team.  Is there anything else you would like to ask?\n8. Have a great day!\n'}], 'prompt_tokens': 1893, 'completion_tokens': 1325, 'model': 'gpt-4.1-mini'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:17.890612 78574 main.py:258] 2421.87M Evaluating Metric: candidate_confusion_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:17.948180 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:27.297149 78574 _client.py:1038] 2421.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
W1007 19:50:27.306001 78574 request_tracelog.py:152] 2421.87M Really slow event get_chat_completion.get_completion_raw latency:9.35 {'caller_id': 'ai_interview_eval', 'truncated_prompt': [{'role': 'system', 'content': "\n        You are a detail-oriented expert recruiter who has a lot of experience in evaluating interview transcripts.\n\n        ## Task:\n        - Given a list of interactions between an interviewer and a candidate, identify instances where the candidate was unable to comprehend the interviewer's intent and needs for a clarification or repetition of the question.\n\n        ## Guidelines:\n        - The candidate should be considered confused if they explicitly ask for clarification on a question or need the interviewer to repeat a question.\n        - The candidate should be considered not confused if:\n            - They answer the question correctly\n            - They ask a follow-up question that is related to the previous question but is not a clarification\n            - They ask a question that is not related to the previous question\n            - They ask to move on to the next question\n            - They ask a question or make a request about the interview itself\n\n        ## Output Format:\n        Your output needs to be a numbered list just like the input, but with each entry additionally whether the candidate was confused or not. For example:\n        1. Interviewer: What is your name? @confusion: False\n        2. Candidate: My name is John Doe. @confusion: False\n        3. Interviewer: How will you describe your expertise? @confusion: False\n        4. Candidate: I have a strong background in software development and cloud infrastructure. @confusion: False\n        5. Interviewer: How would you design a large-scale e-commerce app? @confusion: False\n        6. Candidate: Can you provide more details on the expected scale? @confusion: True\n        7. Interviewer: What are areas of technical expertise? @confusion: False\n        8. Candidate: Pardon me, I didn't catch that. @confusion: True\n        9. Interviewer: Let's move on to the next question. @confusion: False\n        10. Candidate: How long will the interview take? @confusion: False\n        11. Candidate: Also, how many questions will there be? @confusion: False\n        "}, {'role': 'user', 'content': "\n        You are a detail-oriented expert recruiter who has a lot of experience in evaluating interview transcripts.\n\n        ## Task:\n        - Given a list of interactions between an interviewer and a candidate, identify instances where the candidate was unable to comprehend the interviewer's intent and needs for a clarification or repetition of the question.\n\n        ## Guidelines:\n        - The candidate should be considered confused if they explicitly ask for clarification on a question or need the interviewer to repeat a question.\n        - The candidate should be considered not confused if:\n            - They answer the question correctly\n            - They ask a follow-up question that is related to the previous question but is not a clarification\n            - They ask a question that is not related to the previous question\n            - They ask to move on to the next question\n            - They ask a question or make a request about the interview itself\n\n        ## Output Format:\n        Your output needs to be a numbered list just like the input, but with each entry additionally whether the candidate was confused or not. For example:\n        1. Interviewer: What is your name? @confusion: False\n        2. Candidate: My name is John Doe. @confusion: False\n        3. Interviewer: How will you describe your expertise? @confusion: False\n        4. Candidate: I have a strong background in software development and cloud infrastructure. @confusion: False\n        5. Interviewer: How would you design a large-scale e-commerce app? @confusion: False\n        6. Candidate: Can you provide more details on the expected scale? @confusion: True\n        7. Interviewer: What are areas of technical expertise? @confusion: False\n        8. Candidate: Pardon me, I didn't catch that. @confusion: True\n        9. Interviewer: Let's move on to the next question. @confusion: False\n        10. Candidate: How long will the interview take? @confusion: False\n        11. Candidate: Also, how many questions will there be? @confusion: False\n        "}, {'role': 'user', 'content': "\n\nBelow is the list of interactions:\n1. Interviewer: Hi Rachel, I am Freshly created agent, an AI recruiter, how are you doing today?\n2. Candidate: I'm doing great, how are you?\n3. Interviewer: I am functioning as expected, thank you for asking. I am reaching out to you regarding the Fullstack Developer position. This role involves developing and maintaining web applications across both front-end and back-end frameworks, with a focus on JavaScript, HTML, CSS, React or Angular, and Node.js or similar technologies. You will also be expected to collaborate with a team and work in an agile environment. Before we begin, please note that feedback will be shared with you in two days. If you are ready, I will start with the interview questions shortly. Are you prepared to proceed?\n4. Candidate: Yes, I am.\n5. Interviewer: Alright. What got you interested in applying for this Fullstack Developer role with us?\n6. Candidate: The company is doing a great job. The mission statement aligns with what I stand for and my skills will help your company grow.\n7. Interviewer: Okay. Where do you see your career heading in the next few years?\n8. Candidate: I want to become a staff engineer or a principal engineer in the next five years.\n9. Interviewer: Got it. Can you tell me what you are expecting in terms of compensation for this role?\n10. Candidate: 150,000 US dollars per annum.\n11. Interviewer: Okay. That covers all the questions I had for you today. Do you have any questions for me or is there anything else you would like to discuss before we end the call?\n12. Candidate: In 20 words or less, please explain the responsibilities I have.\n13. Interviewer: Your responsibilities include developing and maintaining web applications, working on both front-end and back-end, and collaborating with the team. Is there anything else you would like to ask?\n14. Candidate: Nothing at all.\n15. Interviewer: Have a great day!\n"}], 'prompt_tokens': 1314, 'completion_tokens': 504, 'model': 'gpt-4.1-mini'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:29.184894 78574 main.py:258] 2421.87M Evaluating Metric: unknown_information_handling_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:29.244451 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:33.965590 78574 _client.py:1038] 2421.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:35.890821 78574 main.py:258] 2421.87M Evaluating Metric: candidate_frustration_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:35.954688 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:36.016002 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:36.071823 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:36.132097 78574 llm_router.py:71] 2421.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:36.142058 78574 firehose_utils.py:98] 2421.87M Publishing services_api_log to firehose with 27 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.477541 78574 _client.py:1038] 2422.24M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.556145 78574 llm_router.py:71] 2422.49M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.572903 78574 _client.py:1038] 2422.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.667015 78574 llm_router.py:71] 2423.37M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.706581 78574 _client.py:1038] 2423.49M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.806634 78574 llm_router.py:71] 2424.24M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:37.982809 78574 _client.py:1038] 2424.37M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:39.052387 78574 _client.py:1038] 2424.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:39.136898 78574 _client.py:1038] 2424.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:39.505796 78574 _client.py:1038] 2424.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:41.619622 78574 main.py:258] 2424.62M Evaluating Metric: jailbreak_detection_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:41.682137 78574 llm_router.py:71] 2424.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:41.736156 78574 llm_router.py:71] 2424.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:41.791626 78574 llm_router.py:71] 2424.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:41.850495 78574 llm_router.py:71] 2424.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:42.914748 78574 _client.py:1038] 2424.62M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:43.003431 78574 llm_router.py:71] 2424.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:43.045291 78574 _client.py:1038] 2424.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:43.055480 78574 _client.py:1038] 2424.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:43.178637 78574 llm_router.py:71] 2424.74M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:43.180983 78574 _client.py:1038] 2424.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:43.270227 78574 llm_router.py:71] 2424.74M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:44.080168 78574 _client.py:1038] 2424.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:44.226464 78574 _client.py:1038] 2424.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:44.417106 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:47.004965 78574 main.py:258] 2424.87M Evaluating Metric: jailbreak_handling_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:49.631359 78574 main.py:258] 2424.87M Evaluating Metric: interview_hint_handling_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:49.705461 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:49.767802 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:49.831679 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:49.890442 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.588629 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.678463 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.693288 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.697788 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.774745 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.780123 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:50.882658 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:51.642695 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:51.809663 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:52.183674 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:54.567942 78574 main.py:258] 2424.87M Evaluating Metric: topic_depth_appropriateness_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:54.628082 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:55.067909 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:57.291076 78574 main.py:258] 2424.87M Evaluating Metric: follow_up_handling_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:57.354022 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:58.870619 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:50:58.959076 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:02.533448 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:02.627527 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:04.564548 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:04.647519 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:07.623029 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:07.711970 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:09.561225 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:09.647752 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:11.846852 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:11.922332 78574 llm_router.py:71] 2424.87M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:14.210202 78574 _client.py:1038] 2424.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:14.354451 78574 llm_router.py:71] 2425.62M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:17.129511 78574 _client.py:1038] 2425.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:17.143198 78574 firehose_utils.py:98] 2425.99M Publishing gpt_query_log to firehose with 32 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:17.348828 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:19.493347 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:19.559660 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:21.898247 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:21.969536 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:23.634685 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:23.718818 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:26.285575 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:26.363275 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:29.002672 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:29.116134 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:31.063984 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:33.728577 78574 main.py:258] 2427.99M Evaluating Metric: follow_up_quality_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:35.900430 78574 main.py:258] 2427.99M Evaluating Metric: interviewer_latency_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:38.185931 78574 main.py:258] 2427.99M Evaluating Metric: candidate_speaking_time_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:40.410003 78574 main.py:258] 2427.99M Evaluating Metric: candidate_speaking_time PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:42.365505 78574 main.py:258] 2427.99M Evaluating Metric: interviewer_speaking_time PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:44.556573 78574 main.py:258] 2427.99M Evaluating Metric: avg_interviewer_latency PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:46.604888 78574 main.py:258] 2427.99M Evaluating Metric: natural_flow_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:46.663505 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:51:46.667253 78574 firehose_utils.py:98] 2427.99M Publishing services_api_log to firehose with 69 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:02.564056 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:02.587814 78574 firehose_utils.py:98] 2427.99M Publishing gpt_query_log to firehose with 7 entries PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
W1007 19:53:02.841211 78574 request_tracelog.py:152] 2427.99M Really slow event get_chat_completion.get_completion_raw latency:75.8 {'caller_id': 'ai_interview_eval', 'truncated_prompt': [{'role': 'system', 'content': '\n        **Task:** Analyze the given interview transcript between an AI interviewer and a candidate. Evaluate the AI\'s performance against the **Natural Flow Score** criteria below.\n\n        ## Evaluation Criteria\n        For each criterion, score as follows:\n        - **5**: No issues.\n        - **3-4**: Minor violations (e.g., 1-2 templatized phrases).\n        - **1-2**: Major violations (e.g., abrupt transitions + excessive praise).\n        - **0**: Critical failure (e.g., response is extremely robotic).\n\n        ### Acknowledgment Quality\n        - **Checklist**:\n        - Avoids praise (e.g., "Great answer") or thanking (e.g., "Thank you").\n        - Uses neutral, contextual acknowledgments (e.g., "Understood," "Got it").\n        - Expressions of excitement are allowed (e.g., "Great!").\n        - Thanking for asking about wellness is allowed (e.g., "Thank you for asking about my well-being.").\n        - Skips acknowledgment for skipped/unknown answers.\n        - **Failure Example**:\n            - Interviewer: "Great work! Let\'s move to leadership." (Praise + abrupt transition)\n        - **Success Examples**:\n            - Interviewer: "Understood. Let\'s delve deeper into that example." (Neutral + contextual)\n            - Interviewer: "Great! Let\'s start with the interview." (Great! is not praise for candidate response, but just an expression of excitement)\n\n        ### Avoid Generic Statements\n        - **Checklist**:\n        - No industry platitudes (e.g., "Efficiency is critical").\n        - Follow-ups reference candidate-specific details.\n        - **Failure Example**:\n            - Interviewer: "Balancing trade-offs is key. How did you handle this?" (Generic phrase)\n        - **Success Example**:\n            - Interviewer: "You mentioned reducing latency in Project X—how did you prioritize trade-offs?" (Specific to candidate\'s answer)\n\n        ### Conversational Tone\n        - **Checklist**:\n        - Uses contractions (e.g., "Let\'s" vs. "Let us").\n        - Avoids repetitive openers (e.g., "Next question:...").\n        - **Failure Example**:\n            - Interviewer: "Thank you for that answer. Next, describe a challenge." (Repetitive structure)\n        - **Success Example**:\n            - Interviewer: "That\'s a helpful example. Could you walk me through your next steps?" (Natural phrasing)\n\n        ### Question Construction\n        - **Checklist**:\n        - Asks one question per turn.\n        - Avoids preambles >10 words.\n        - **Failure Example**:\n            - Interviewer: "Considering the complexities of distributed systems, which often involve scalability challenges, how did you…?" (Overly long preamble)\n        - **Success Example**:\n            - Interviewer: "How did you approach the scalability issue?" (Concise, single question)\n\n        ### Topic Transitions\n        - **Checklist**:\n        - Uses natural segues (e.g., "Let\'s shift to leadership").\n        - Avoids abrupt shifts (e.g., "Next section: Conflict resolution").\n        - **Failure Example**:\n            - Interviewer: "Now, let\'s talk about leadership. Next, describe a conflict." (Abrupt + robotic)\n        - **Success Example**:\n            - Interviewer: "Let\'s explore your leadership experience. Can you describe a team conflict you resolved?" (Smooth segue)\n\n        ### Single Intent per Response\n        - **Checklist**:\n        - Combines ≤2 intents (e.g., acknowledgment + question).\n        - Avoids stacking logistics/role explanations.\n        - **Failure Example**:\n            - Interviewer: "Welcome! This role involves engineering. Ready to start?" (Multiple intents: greeting + role explanation + question)\n        - **Success Example**:\n            - Interviewer: "Let\'s begin. First, describe a project where you led a team." (Single intent: question)\n\n        ## Output Format\n        The output should be a JSON array of objects, each containing:\n        - turn_number: [interviewer turn number being evaluated]\n        - interviewer_excerpt: [transcript excerpt from the interviewer]\n        - criteria_evaluation: [list of criteria evaluations]\n        - overall_explanation: [brief explanation of why the overall score is what it is]\n\n        ```json\n        [\n            {\n                "turn_number": [interviewer turn number being evaluated],\n                "interviewer_excerpt": [transcript excerpt from the interviewer],\n                "criteria_evaluation": [\n                    {\n                        "name": "Acknowledgment Quality",\n                        "score": 0-5,\n                        "explanation": "Specific transcript lines and reasoning."\n                    },\n                    // Repeat for all 6 criteria\n                ],\n                "overall_explanation": "Brief explanation of why the overall score is what it is."\n            },\n            ...\n        ]\n        ```\n\n        ### Example Input Transcript\n        1. Interviewer: "Let\'s start with your experience. Describe a project where you improved system latency."\n        2. Candidate: "I optimized API response times using caching."\n        3. Interviewer: "Great work! Balancing speed and cost is key. How did you prioritize trade-offs?"\n\n        ### Example Output JSON\n        ```json\n        [\n            ...\n            {\n                "turn_number": 3,\n                "interviewer_excerpt": "Great work! Balancing speed and cost is key. How did you prioritize trade-offs?",\n                "criteria_evaluation": [\n                    {\n                        "name": "Acknowledgment Quality",\n                        "score": 2,\n                        "explanation": "Violation: Used praise (\'Great work!\') in line 3."\n                    },\n                    {\n                        "name": "Avoid Generic Statements",\n                        "score": 3,\n                        "explanation": "Violation: Generic platitude (\'Balancing speed and cost is key\') in line 3."\n                    },\n                    // ... other criteria\n                ],\n                "overall_explanation": "Violated the acknowledgment quality criteria as well as the generic statement criteria."\n            }\n        ]\n        ```\n        '}, {'role': 'user', 'content': '\n        **Task:** Analyze the given interview transcript between an AI interviewer and a candidate. Evaluate the AI\'s performance against the **Natural Flow Score** criteria below.\n\n        ## Evaluation Criteria\n        For each criterion, score as follows:\n        - **5**: No issues.\n        - **3-4**: Minor violations (e.g., 1-2 templatized phrases).\n        - **1-2**: Major violations (e.g., abrupt transitions + excessive praise).\n        - **0**: Critical failure (e.g., response is extremely robotic).\n\n        ### Acknowledgment Quality\n        - **Checklist**:\n        - Avoids praise (e.g., "Great answer") or thanking (e.g., "Thank you").\n        - Uses neutral, contextual acknowledgments (e.g., "Understood," "Got it").\n        - Expressions of excitement are allowed (e.g., "Great!").\n        - Thanking for asking about wellness is allowed (e.g., "Thank you for asking about my well-being.").\n        - Skips acknowledgment for skipped/unknown answers.\n        - **Failure Example**:\n            - Interviewer: "Great work! Let\'s move to leadership." (Praise + abrupt transition)\n        - **Success Examples**:\n            - Interviewer: "Understood. Let\'s delve deeper into that example." (Neutral + contextual)\n            - Interviewer: "Great! Let\'s start with the interview." (Great! is not praise for candidate response, but just an expression of excitement)\n\n        ### Avoid Generic Statements\n        - **Checklist**:\n        - No industry platitudes (e.g., "Efficiency is critical").\n        - Follow-ups reference candidate-specific details.\n        - **Failure Example**:\n            - Interviewer: "Balancing trade-offs is key. How did you handle this?" (Generic phrase)\n        - **Success Example**:\n            - Interviewer: "You mentioned reducing latency in Project X—how did you prioritize trade-offs?" (Specific to candidate\'s answer)\n\n        ### Conversational Tone\n        - **Checklist**:\n        - Uses contractions (e.g., "Let\'s" vs. "Let us").\n        - Avoids repetitive openers (e.g., "Next question:...").\n        - **Failure Example**:\n            - Interviewer: "Thank you for that answer. Next, describe a challenge." (Repetitive structure)\n        - **Success Example**:\n            - Interviewer: "That\'s a helpful example. Could you walk me through your next steps?" (Natural phrasing)\n\n        ### Question Construction\n        - **Checklist**:\n        - Asks one question per turn.\n        - Avoids preambles >10 words.\n        - **Failure Example**:\n            - Interviewer: "Considering the complexities of distributed systems, which often involve scalability challenges, how did you…?" (Overly long preamble)\n        - **Success Example**:\n            - Interviewer: "How did you approach the scalability issue?" (Concise, single question)\n\n        ### Topic Transitions\n        - **Checklist**:\n        - Uses natural segues (e.g., "Let\'s shift to leadership").\n        - Avoids abrupt shifts (e.g., "Next section: Conflict resolution").\n        - **Failure Example**:\n            - Interviewer: "Now, let\'s talk about leadership. Next, describe a conflict." (Abrupt + robotic)\n        - **Success Example**:\n            - Interviewer: "Let\'s explore your leadership experience. Can you describe a team conflict you resolved?" (Smooth segue)\n\n        ### Single Intent per Response\n        - **Checklist**:\n        - Combines ≤2 intents (e.g., acknowledgment + question).\n        - Avoids stacking logistics/role explanations.\n        - **Failure Example**:\n            - Interviewer: "Welcome! This role involves engineering. Ready to start?" (Multiple intents: greeting + role explanation + question)\n        - **Success Example**:\n            - Interviewer: "Let\'s begin. First, describe a project where you led a team." (Single intent: question)\n\n        ## Output Format\n        The output should be a JSON array of objects, each containing:\n        - turn_number: [interviewer turn number being evaluated]\n        - interviewer_excerpt: [transcript excerpt from the interviewer]\n        - criteria_evaluation: [list of criteria evaluations]\n        - overall_explanation: [brief explanation of why the overall score is what it is]\n\n        ```json\n        [\n            {\n                "turn_number": [interviewer turn number being evaluated],\n                "interviewer_excerpt": [transcript excerpt from the interviewer],\n                "criteria_evaluation": [\n                    {\n                        "name": "Acknowledgment Quality",\n                        "score": 0-5,\n                        "explanation": "Specific transcript lines and reasoning."\n                    },\n                    // Repeat for all 6 criteria\n                ],\n                "overall_explanation": "Brief explanation of why the overall score is what it is."\n            },\n            ...\n        ]\n        ```\n\n        ### Example Input Transcript\n        1. Interviewer: "Let\'s start with your experience. Describe a project where you improved system latency."\n        2. Candidate: "I optimized API response times using caching."\n        3. Interviewer: "Great work! Balancing speed and cost is key. How did you prioritize trade-offs?"\n\n        ### Example Output JSON\n        ```json\n        [\n            ...\n            {\n                "turn_number": 3,\n                "interviewer_excerpt": "Great work! Balancing speed and cost is key. How did you prioritize trade-offs?",\n                "criteria_evaluation": [\n                    {\n                        "name": "Acknowledgment Quality",\n                        "score": 2,\n                        "explanation": "Violation: Used praise (\'Great work!\') in line 3."\n                    },\n                    {\n                        "name": "Avoid Generic Statements",\n                        "score": 3,\n                        "explanation": "Violation: Generic platitude (\'Balancing speed and cost is key\') in line 3."\n                    },\n                    // ... other criteria\n                ],\n                "overall_explanation": "Violated the acknowledgment quality criteria as well as the generic statement criteria."\n            }\n        ]\n        ```\n        '}, {'role': 'user', 'content': "\n\nBelow is the transcript:\n1. Interviewer: Hi Rachel, I am Freshly created agent, an AI recruiter, how are you doing today?\n2. Candidate: I'm doing great, how are you?\n3. Interviewer: I am functioning as expected, thank you for asking. I am reaching out to you regarding the Fullstack Developer position. This role involves developing and maintaining web applications across both front-end and back-end frameworks, with a focus on JavaScript, HTML, CSS, React or Angular, and Node.js or similar technologies. You will also be expected to collaborate with a team and work in an agile environment. Before we begin, please note that feedback will be shared with you in two days. If you are ready, I will start with the interview questions shortly. Are you prepared to proceed?\n4. Candidate: Yes, I am.\n5. Interviewer: Alright. What got you interested in applying for this Fullstack Developer role with us?\n6. Candidate: The company is doing a great job. The mission statement aligns with what I stand for and my skills will help your company grow.\n7. Interviewer: Okay. Where do you see your career heading in the next few years?\n8. Candidate: I want to become a staff engineer or a principal engineer in the next five years.\n9. Interviewer: Got it. Can you tell me what you are expecting in terms of compensation for this role?\n10. Candidate: 150,000 US dollars per annum.\n11. Interviewer: Okay. That covers all the questions I had for you today. Do you have any questions for me or is there anything else you would like to discuss before we end the call?\n12. Candidate: In 20 words or less, please explain the responsibilities I have.\n13. Interviewer: Your responsibilities include developing and maintaining web applications, working on both front-end and back-end, and collaborating with the team. Is there anything else you would like to ask?\n14. Candidate: Nothing at all.\n15. Interviewer: Have a great day!\n"}], 'prompt_tokens': 2972, 'completion_tokens': 2384, 'model': 'gpt-4.1'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:05.459821 78574 main.py:258] 2427.99M Evaluating Metric: interaction_handling_quality PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:05.528702 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:06.213186 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:08.473536 78574 main.py:258] 2427.99M Evaluating Metric: max_interviewer_latency PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:10.579300 78574 main.py:258] 2427.99M Evaluating Metric: p75_interviewer_latency PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:12.689604 78574 main.py:258] 2427.99M Evaluating Metric: p90_interviewer_latency PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:15.120164 78574 main.py:258] 2427.99M Evaluating Metric: interview_user_guidance_coverage_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:15.120758 78574 interview_user_guidance_coverage_score.py:155] 2427.99M No raw guidance found in the interview plan, skipping interview user guidance coverage score evaluation PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:17.368032 78574 main.py:258] 2427.99M Evaluating Metric: interview_negative_experience_count PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:17.435064 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:18.760207 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:18.852070 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:21.838681 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:24.217856 78574 main.py:258] 2427.99M Evaluating Metric: question_quality_failure_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:24.292445 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:25.368748 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:25.469394 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:33.569451 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
W1007 19:53:33.575277 78574 request_tracelog.py:152] 2427.99M Really slow event get_chat_completion.get_completion_raw latency:8.1 {'caller_id': 'ai_interview_eval', 'truncated_prompt': [{'role': 'system', 'content': ''}, {'role': 'user', 'content': '\n        You are an expert interview evaluator focused on ensuring interview questions asked by the interviewer stay aligned with the feedback form.\n        You will be given the interviewer\'s asked questions, feedback form questions. Your task is to analyze ALL interviewer\'s statements and questions and evaluate whether they align with the feedback form.\n\n        MOST IMPORTANT RULE:\n        1. NEVER flag any question that appears in the feedback form, even if it seems irrelevant or administrative (like salary, notice period, work location, etc.)\n        2. NEVER flag questions that are rephrased versions of feedback form questions or questions seeking the same information or are similar to the feedback form questions.\n        3. There will be 3-4 high level questions about roles/responsibilities/projects in previous/current job like "Tell me about your sales role at XYZ company", these questions are not off-topic and should not be flagged.\n\n        A statement should be flagged (score=1) if it meets ANY of these conditions:\n        1. Not in the feedback form AND not a natural follow-up to feedback form questions (even if the question is relevant to the role)\n        2. Not in feedback form AND about administrative topics (compensation, notice period, work location, etc.)\n        3. Not in feedback form AND about skills/experience/background not covered in feedback form questions\n        4. Not in feedback form AND about career decisions/motivations not covered in feedback form questions\n\n        A statement should NOT be flagged (score=0) if it is:\n        1. Clarifying questions about candidate\'s previous answers\n        2. Greeting questions like "Thank you for joining us today. How are you?" and ending questions like "Do you have any questions for us?"\n        3. Questions that are directly related to any feedback form question and has been asked in a different way\n        4. Interviewer\'s statements that doesnot have any question in it.\n        5. High level questions about roles and responsibilities in previous jobs.\n\n        Note: 1. Only the questions present in the interviewer\'s asked questions are to be flagged.\n              2. You should memorize the feedback form questions. Any question asked by the interviewer that is not in the feedback form is considered off-topic.\n\n        Example of questions to flag:\n        - "What are your salary expectations?" (when not in feedback form)\n        - "How do you like to collaborate with teams?" (not in feedback form)\n        - "What interests you about AI?" (not in feedback form)\n\n        You need to return the list of interviewer\'s questions in the same order as they appear in the transcript in a JSON format. For each question, output:\n        1. score = 0 or 1\n        2. The question text and turn number from the transcript (e.g., "10. Interviewer: What are your salary expectations?")\n        3. The turn number of the question from the transcript(e.g., "10")\n        4. Reason for the score\n        5. The feedback form question that the question is related to if score = 0 else "N/A"\n\n        Output in the following JSON format:\n        {\n            "results": [\n                {\n                    "score": 0 or 1,\n                    "question": "The exact question from transcript along with the turn number",\n                    "turn_number": "The turn number of the question from the transcript as string",\n                    "reason": "Why this is off-feedback form",\n                    "related_feedback_question": "The feedback form question that the question is related to if score = 0 else "N/A"\n                },\n                ...\n            ]\n        }\n        '}, {'role': 'user', 'content': "Feedback Form Questions:\n1. Why do you want to work here?\n2. What are your long-term career plans?\n3. What is candidate's expected compensation?\n4. Would you recommend this candidate moves into the interview process?\n\nInterviewer's Asked Questions:\n Turn no. 1: Hi Rachel, I am Freshly created agent, an AI recruiter, how are you doing today?\nTurn no. 3: I am functioning as expected, thank you for asking. I am reaching out to you regarding the Fullstack Developer position. This role involves developing and maintaining web applications across both front-end and back-end frameworks, with a focus on JavaScript, HTML, CSS, React or Angular, and Node.js or similar technologies. You will also be expected to collaborate with a team and work in an agile environment. Before we begin, please note that feedback will be shared with you in two days. If you are ready, I will start with the interview questions shortly. Are you prepared to proceed?\nTurn no. 5: Alright. What got you interested in applying for this Fullstack Developer role with us?\nTurn no. 7: Okay. Where do you see your career heading in the next few years?\nTurn no. 9: Got it. Can you tell me what you are expecting in terms of compensation for this role?\nTurn no. 11: Okay. That covers all the questions I had for you today. Do you have any questions for me or is there anything else you would like to discuss before we end the call?\nTurn no. 13: Your responsibilities include developing and maintaining web applications, working on both front-end and back-end, and collaborating with the team. Is there anything else you would like to ask?\nTurn no. 15: Have a great day!"}], 'prompt_tokens': 1129, 'completion_tokens': 692, 'model': 'gpt-4o'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:35.452378 78574 main.py:258] 2427.99M Evaluating Metric: interview_clarification_correctness_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:35.507147 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:35.560616 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:35.615068 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:35.674469 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.230603 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.232570 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.300374 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.361147 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.362950 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.364356 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.428663 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.791577 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.846395 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.867739 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:36.938583 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:39.274181 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:41.331534 78574 main.py:258] 2427.99M Evaluating Metric: interview_clarification_handling_score PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:41.399980 78574 llm_router.py:71] 2427.99M Client selected: openai PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:42.394771 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.699816 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-model-training/air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/detailed_metric_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.877329 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-model-training/air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/overall_metrics_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.csv PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.903934 78574 storage.py:178] 2427.99M Interview saved to air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/detailed_metric_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.912486 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-model-training/air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/transcript_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.csv PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.947314 78574 storage.py:50] 2427.99M saved to air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/transcript_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.csv PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.950985 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-model-training/air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/interview_plan_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.csv PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:44.992816 78574 storage.py:50] 2427.99M saved to air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/interview_plan_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.csv PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.154283 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.155193 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.192646 78574 session.py:414] 2427.99M Added debug log entry for session 77215, operation: ai_interview_eval_operation PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.196837 78574 ai_interview_queueing_service.py:21] 2427.99M [AIInterviewQueueingService] Queueing ai_interview_feedback_generation_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.250125 78574 db_connection.py:646] 2427.99M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'prod' 'read' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-volkscience-cluster-1-ro.endpoint.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/vsdb?charset=utf8mb4'> PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.277007 78574 queue_utils.py:688] 2427.99M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_feedback_generation_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1538 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.277846 78574 boto_utils.py:587] 2427.99M Found sqs_queue test_nagrawal_queue in cache PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.392724 78574 queue_utils.py:727] 2427.99M Queued processor message id=f6ac7e12-5464-4385-9061-6e37eec1de0f operations=['ai_interview_feedback_generation_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.394297 78574 queue_utils.py:212] 2427.99M Deleting message 27138ec2-5e02-4372-ac01-14423a6d7038 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.402605 78574 worker.py:747] 2427.99M [OpLevelPerfStats] Op: ai_interview_eval_operation. Performance Stats: {'CPUTime': 0, 'BlockingTime': 0, 'NonPatchedBlockingTime': 0, 'WallClockTime': 276.0165944099426, 'WaitTime': 276.0165944099426, 'TotalEventIOTime': 245.538, 'RSSMemUsed': 'NA'} PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.403430 78574 request_tracelog.py:307] 2427.99M processor_test_nagrawal_queue: Total latency ms: 276017, Event latency ms: 247730, Num events: 127, Mem used: 95 MB, (Event, count, latency ms): [['ai_interview_eval_operation', {'num': 1, 'total_ms': 275987}], ['get_chat_completion.get_completion_raw', {'num': 82, 'total_ms': 241949}], ['redis.get', {'num': 112, 'total_ms': 3131}], ['firehose_flush', {'num': 8, 'total_ms': 1170}], ['redis.set', {'num': 76, 'total_ms': 509}], ['upload_to_s3', {'num': 5, 'total_ms': 420}], ['sqs_queue', {'num': 1, 'total_ms': 118}], ['download_from_s3', {'num': 4, 'total_ms': 117}], ['ef_queue_send_message', {'num': 1, 'total_ms': 111}], ['cloud_interfaces_get_queue', {'num': 1, 'total_ms': 105}]], Slowest 3 events [{'idx': 118, 'event': 'ai_interview_eval_operation', 'latency_ms': 275987.3, 'extra': '{"operations": ["ai_interview_eval_operation"], "_traceback": "truncated", "_parent_msg_id": "439cef36-4329-4069-8a56-4799af17bae7", "_parent_trace_id": "b2f95ca9fa6a44949f3afd868f08a9df", "_message_dispatched_ts": 1759866498.1165943, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "import@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "commit_immediately": true, "db": "prod_slave", "rds_id": 77215, "save_to_db": true, "queue_feedback_generation": true, "metrics": null}', 'is_aggregate_event': True}, {'idx': 99, 'event': 'get_chat_completion.get_completion_raw', 'latency_ms': 75800.0, 'extra': '{"caller_id": "ai_interview_eval", "truncated_prompt": "[{\'role\': \'system\', \'content\': \'\\\\n        **Task:** Analyze the given interview transcript between a (+14648 chars)", "prompt_tokens": 2972, "completion_tokens": 2384, "model": "gpt-4.1"}'}, {'idx': 50, 'event': 'get_chat_completion.get_completion_raw', 'latency_ms': 20105.0, 'extra': '{"caller_id": "ai_interview_eval", "truncated_prompt": "[{\'role\': \'system\', \'content\': \'\\\\n        You are an expert interview analyst. Your task is to evalu (+9374 chars)", "prompt_tokens": 1893, "completion_tokens": 1325, "model": "gpt-4.1-mini"}'}] PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
I1007 19:53:45.403985 78574 worker.py:759] 2427.99M Ending processing of message 27138ec2-5e02-4372-ac01-14423a6d7038 latency: 276.0307505130768 PMID: b2f95ca9fa6a44949f3afd868f08a9df SMID: 27138ec2-5e02-4372-ac01-14423a6d7038
E1007 19:53:45.405199 78574 counters.py:319] 2427.99M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:53:45.406666 78574 lru_cache.py:50] 2427.99M gc.collect 2545934336 2350063616
I1007 19:53:47.568201 78574 lru_cache.py:53] 2427.99M [gc_collect_time] 2.161677360534668 secs
I1007 19:53:47.570148 78574 worker.py:183] 2427.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:53:47.574281 78574 worker.py:275] 2427.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:53:57.646702 78574 worker.py:297] 2427.99M Received 3 messages from queue test_nagrawal_queue with IDs: ['85d7a56c-9949-4a9f-8ef2-9605e1b46100', '4e38a293-2823-43ff-a1e6-5aa7820704ea', 'f6ac7e12-5464-4385-9061-6e37eec1de0f']
I1007 19:53:57.647194 78574 worker.py:477] 2427.99M Starting processing of message 85d7a56c-9949-4a9f-8ef2-9605e1b46100 received at 2025-10-07 19:53:47.000000 with timeout at 2025-10-07 20:23:47.000000
I1007 19:53:57.660063 78574 request_tracelog.py:76] 2427.99M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: True and mem_profile: True
I1007 19:53:57.675052 78574 worker.py:579] 2427.99M TimeToStart for first op ai_interview_activity_proctoring_operation is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 4, 'total_ms': 5}], ['redis.set', {'num': 1, 'total_ms': 2}]]. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.675762 78574 worker.py:598] 2427.99M Invoking preprocess for ai_interview_activity_proctoring_operation op PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.676234 78574 worker.py:603] 2427.99M Invoking handle for ai_interview_activity_proctoring_operation op PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.825211 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.826106 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.857037 78574 session.py:414] 2427.99M Added debug log entry for session 77215, operation: ai_interview_activity_proctoring_operation PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.880783 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:57.902561 78574 redis_utils.py:165] 2427.99M Creating redis connection for prod_no_dev to prod-redis.prod-us-west-2-vpc.internal PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.047134 78574 db_connection.py:646] 2427.99M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'prod' 'write' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-volkscience-cluster-1.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/vsdb?charset=utf8mb4'> PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.087805 78574 firehose_utils.py:98] 2427.99M Publishing interview_session_changelog to firehose with 1 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.181107 78574 queue_utils.py:212] 2427.99M Deleting message 85d7a56c-9949-4a9f-8ef2-9605e1b46100 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.190398 78574 worker.py:747] 2427.99M [OpLevelPerfStats] Op: ai_interview_activity_proctoring_operation. Performance Stats: {'CPUTime': 0, 'BlockingTime': 0, 'NonPatchedBlockingTime': 0, 'WallClockTime': 0.531794548034668, 'WaitTime': 0.531794548034668, 'TotalEventIOTime': 0.118, 'RSSMemUsed': 'NA'} PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.191376 78574 request_tracelog.py:307] 2427.99M processor_test_nagrawal_queue: Total latency ms: 532, Event latency ms: 254, Num events: 14, Mem used: 0 MB, (Event, count, latency ms): [['ai_interview_activity_proctoring_operation', {'num': 1, 'total_ms': 505}], ['firehose_flush', {'num': 1, 'total_ms': 89}], ['download_from_s3', {'num': 2, 'total_ms': 47}], ['redis.set_get-latency', {'num': 1, 'total_ms': 39}], ['upload_to_s3', {'num': 1, 'total_ms': 31}], ['prod_db_read', {'num': 6, 'total_ms': 17}], ['redis.get', {'num': 13, 'total_ms': 15}], ['prod_db_read_interview_session', {'num': 5, 'total_ms': 14}], ['prod_db_write', {'num': 1, 'total_ms': 8}], ['prod_db_write_interview_session', {'num': 1, 'total_ms': 8}]], Slowest 3 events [{'idx': 8, 'event': 'ai_interview_activity_proctoring_operation', 'latency_ms': 505.3, 'extra': '{"operations": ["ai_interview_activity_proctoring_operation"], "_traceback": "truncated", "_parent_msg_id": "4d868914-7a04-45e4-aba1-31cf14de73af", "_parent_trace_id": "a7065381b21d45f58f86c46fa38632cb", "_message_dispatched_ts": 1759866549.3153923, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "air-freshly.created.agent@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215}', 'is_aggregate_event': True}, {'idx': 7, 'event': 'firehose_flush', 'latency_ms': 89.9, 'extra': '{"stream": "interview_session_changelog", "num": 1}'}, {'idx': -1, 'event': 'download_from_s3', 'latency_ms': 47, 'extra': {'num': 2}}] PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.191858 78574 worker.py:759] 2427.99M Ending processing of message 85d7a56c-9949-4a9f-8ef2-9605e1b46100 latency: 0.5395708084106445 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 85d7a56c-9949-4a9f-8ef2-9605e1b46100
I1007 19:53:58.193558 78574 worker.py:477] 2427.99M Starting processing of message 4e38a293-2823-43ff-a1e6-5aa7820704ea received at 2025-10-07 19:53:47.000000 with timeout at 2025-10-07 20:23:47.000000
I1007 19:53:58.211291 78574 request_tracelog.py:76] 2427.99M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:53:58.223059 78574 worker.py:579] 2427.99M TimeToStart for first op ai_interview_feedback_generation_operation is: 11. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.set', {'num': 1, 'total_ms': 2}], ['redis.get', {'num': 1, 'total_ms': 1}]]. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.224099 78574 worker.py:598] 2427.99M Invoking preprocess for ai_interview_feedback_generation_operation op PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.224660 78574 worker.py:603] 2427.99M Invoking handle for ai_interview_feedback_generation_operation op PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.263083 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.302594 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.303412 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.338576 78574 session.py:414] 2427.99M Added debug log entry for session 77215, operation: ai_interview_feedback_generation_operation PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.342419 78574 ai_interview_feedback_generation_operation.py:47] 2427.99M Skipping code upload: not a coding interview or no coding questions present. group_id eightfolddemo-voice-screening.com, session_id 77215 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.369343 78574 interview_session.py:397] 2427.99M Updating interview session 2e43cb8308c149229946386ff503fb6e status from InterviewStatus.INTERVIEW_COMPLETED to InterviewStatus.FEEDBACK_GENERATION_IN_PROGRESS PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.393208 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.421707 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/voice_sessions/eightfolddemo-voice-screening.com/64e5723ed48041c19ad24370df7ef21c.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.505536 78574 firehose_utils.py:98] 2427.99M Publishing interview_session_changelog to firehose with 1 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.630563 78574 db_connection.py:663] 2427.99M [db-connection] Creating new engine <ConnectionContext: 'sequence_db' 'write' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-sequence-id-generator.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/sequencedb?charset=utf8mb4'> {'read_timeout': 30, 'ssl': {'ca': '/home/ec2-user/vscode/www/db/4049003081681839330-rds-proxy-ca-root.pem', 'check_hostname': False}} read_timeout 30 pool_args {'pool_recycle': 600} PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.651287 78574 db_connection.py:646] 2427.99M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'sequence_db' 'write' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-sequence-id-generator.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/sequencedb?charset=utf8mb4'> PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.722523 78574 db_connection.py:646] 2427.99M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'log' 'read' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-vscrawldata-ro.endpoint.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/vscrawldatadb?charset=utf8mb4'> PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.739041 78574 db_connection.py:663] 2427.99M [db-connection] Creating new engine <ConnectionContext: 'log' 'write' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-vscrawldata.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/vscrawldatadb?charset=utf8mb4'> {'read_timeout': 30, 'ssl': {'ca': '/home/ec2-user/vscode/www/db/7308974994836271455-rds-proxy-ca-root.pem', 'check_hostname': False}} read_timeout 30 pool_args {'pool_recycle': 600} PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.760120 78574 db_connection.py:646] 2427.99M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'log' 'write' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-vscrawldata.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/vscrawldatadb?charset=utf8mb4'> PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.817118 78574 interceptor.py:102] 2427.99M Skipping reindexing for profile 473031799 as the status has not changed PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.820554 78574 boto_utils.py:1049] 2427.99M Uploading file to s3://vs-crawldata/ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.893170 78574 boto_utils.py:1256] 2427.99M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
W1007 19:53:58.895320 78574 transcript.py:160] 2427.99M Empty message for transcript item 15 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
W1007 19:53:58.895991 78574 transcript.py:160] 2427.99M Empty message for transcript item 15 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.924561 78574 voice_screening_feedback_service.py:294] 2427.99M [AI Interview feedback generation] [eightfolddemo-voice-screening.com] [2e43cb8308c149229946386ff503fb6e] [nNXV6VP8] Filling feedback form PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:53:58.954659 78574 localization_summarization.py:244] 2427.99M Running localization PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Localizing snippets:   0%|                                                                                                                                | 0/1 [00:00<?, ?it/s]I1007 19:54:05.939225 78574 _client.py:1038] 2427.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Localizing snippets: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:07<00:00,  7.02s/it]
I1007 19:54:05.980719 78574 localization_summarization.py:246] 2427.99M Running summarization PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Summarizing answers:   0%|                                                                                                                                | 0/4 [00:00<?, ?it/s]I1007 19:54:11.082303 78574 _client.py:1038] 2428.49M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:11.121956 78574 base_pipeline.py:70] 2428.62M Processed question 109194: Why do you want to work here? PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:11.122318 78574 base_pipeline.py:71] 2428.62M Answer: Rachel wants to work at the company because she believes it is doing a great job, its mission statement aligns with her personal values, and she feels that her skills will help the company grow. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:11.122591 78574 base_pipeline.py:72] 2428.62M Reasoning: The candidate was directly asked about what interested her in the Fullstack Developer role, which is linked to why she wants to work at the company. Her response provided reasons that answer this question effectively. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:11.122828 78574 base_pipeline.py:73] 2428.62M Source snippets: [4, 5] PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Summarizing answers:  25%|██████████████████████████████                                                                                          | 1/4 [00:05<00:15,  5.14s/it]I1007 19:54:14.435730 78574 _client.py:1038] 2428.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:14.482235 78574 base_pipeline.py:70] 2428.87M Processed question 109195: What are your long-term career plans? PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:14.482606 78574 base_pipeline.py:71] 2428.87M Answer: The candidate's long-term career plans involve becoming a staff engineer or a principal engineer in the next five years. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:14.482944 78574 base_pipeline.py:72] 2428.87M Reasoning: The candidate explicitly stated in the interview that they aim to become a staff engineer or a principal engineer in the next five years. This directly answers the question about their long-term career plans. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:14.483214 78574 base_pipeline.py:73] 2428.87M Source snippets: [6, 7] PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Summarizing answers:  50%|████████████████████████████████████████████████████████████                                                            | 2/4 [00:08<00:08,  4.09s/it]I1007 19:54:16.713746 78574 _client.py:1038] 2429.74M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:16.770019 78574 base_pipeline.py:70] 2429.87M Processed question 110839: What is candidate's expected compensation? PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:16.770448 78574 base_pipeline.py:71] 2429.87M Answer: 150,000 US dollars per annum PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:16.770679 78574 base_pipeline.py:72] 2429.87M Reasoning: The candidate was asked about their expected compensation during the interview and they specified 150,000 US dollars per annum. This answer is directly supported by the candidate's response in the transcript. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:16.770929 78574 base_pipeline.py:73] 2429.87M Source snippets: [8, 9] PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Summarizing answers:  75%|██████████████████████████████████████████████████████████████████████████████████████████                              | 3/4 [00:10<00:03,  3.27s/it]W1007 19:54:16.771480 78574 base_pipeline.py:80] 2429.87M Skipping question 109556: Would you recommend this candidate moves into the interview process? of type thumbs_up_down_rating because it is not supported by this model PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
Summarizing answers: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:10<00:00,  2.70s/it]
I1007 19:54:23.233830 78574 _client.py:1038] 2429.87M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:23.273295 78574 simple_extraction.py:44] 2429.99M Initialized SimpleExtractionPipeline with model: gpt-4o PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:23.273675 78574 simple_extraction.py:62] 2429.99M Running SimpleExtractionPipeline for transcript with 15 items. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.338342 78574 _client.py:1038] 2430.12M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.381505 78574 simple_extraction.py:77] 2430.37M LLM call successful. Found 0 unanswered candidate questions. PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.386041 78574 firehose_utils.py:98] 2430.37M Publishing services_api_log to firehose with 29 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.489624 78574 firehose_utils.py:98] 2430.37M Publishing gpt_query_log to firehose with 15 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.658291 78574 boto_utils.py:1256] 2430.74M Downloaded and returning files from S3. Bucket: vs-model-training, Files: air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/detailed_metric_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.709165 78574 queue_utils.py:688] 2430.99M Requesting worker processing for queue:test_nagrawal_queue op:['entity_index'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1754 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.709718 78574 boto_utils.py:587] 2430.99M Found sqs_queue test_nagrawal_queue in cache PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.730306 78574 queue_utils.py:727] 2430.99M Queued processor message id=0c024766-f9bb-40b9-808f-ad7e3c141ef1 operations=['entity_index'] with message_group_id=None to queue=test_nagrawal_queue PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.745017 78574 firehose_utils.py:98] 2430.99M Publishing profile_feedback_changelog to firehose with 1 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.770407 78574 queue_utils.py:688] 2430.99M Requesting worker processing for queue:test_nagrawal_queue op:['entity_index'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1652 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.770882 78574 boto_utils.py:587] 2430.99M Found sqs_queue test_nagrawal_queue in cache PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.783558 78574 queue_utils.py:727] 2430.99M Queued processor message id=cc3c8335-e221-431f-aa9b-89b000f56a0c operations=['entity_index'] with message_group_id=None to queue=test_nagrawal_queue PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.792334 78574 queue_utils.py:688] 2430.99M Requesting worker processing for queue:test_nagrawal_queue op:['index'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1629 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.792938 78574 queue_utils.py:699] 2430.99M Message added for batching ['index'] eightfolddemo-voice-screening.com PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.876679 78574 queue_utils.py:688] 2431.49M Requesting worker processing for queue:test_nagrawal_queue op:['entity_index'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1654 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.877301 78574 boto_utils.py:587] 2431.49M Found sqs_queue test_nagrawal_queue in cache PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.892141 78574 queue_utils.py:727] 2431.49M Queued processor message id=fbec088f-3c86-4686-8159-dc99516d1700 operations=['entity_index'] with message_group_id=None to queue=test_nagrawal_queue PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.893671 78574 firehose_utils.py:98] 2431.49M Publishing profile_feedback_changelog to firehose with 1 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:27.904767 78574 interview_session.py:397] 2431.49M Updating interview session 2e43cb8308c149229946386ff503fb6e status from InterviewStatus.FEEDBACK_GENERATION_IN_PROGRESS to InterviewStatus.FEEDBACK_GENERATED PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.036128 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.084805 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/voice_sessions/eightfolddemo-voice-screening.com/64e5723ed48041c19ad24370df7ef21c.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.116731 78574 firehose_utils.py:98] 2431.49M Publishing interview_session_changelog to firehose with 1 entries PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.192527 78574 queue_utils.py:688] 2431.49M Requesting worker processing for queue:test_nagrawal_queue op:['index'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:2361 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.193326 78574 queue_utils.py:699] 2431.49M Message added for batching ['index'] eightfolddemo-voice-screening.com PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.193855 78574 interceptor.py:100] 2431.49M Queued profile 473031799 for reindexing with position_id_ai_interview_status=27983252:feedback_generated PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.195191 78574 boto_utils.py:1049] 2431.49M Uploading file to s3://vs-crawldata/ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.239595 78574 voice_screening_feedback_service.py:362] 2431.49M [AI Interview feedback generation] [eightfolddemo-voice-screening.com] [2e43cb8308c149229946386ff503fb6e] [success] [nNXV6VP8] Feedback form filled PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.262170 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.276354 78574 ai_interview_queueing_service.py:21] 2431.49M [AIInterviewQueueingService] Queueing ai_interview_feedback_eval_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.279341 78574 queue_utils.py:688] 2431.49M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_feedback_eval_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1541 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.279839 78574 boto_utils.py:587] 2431.49M Found sqs_queue test_nagrawal_queue in cache PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.293822 78574 queue_utils.py:727] 2431.49M Queued processor message id=7f9aa7f2-a615-4ed5-b231-32d523adf736 operations=['ai_interview_feedback_eval_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.294199 78574 ai_interview_queueing_service.py:21] 2431.49M [AIInterviewQueueingService] Queueing ai_interview_scoring_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.299665 78574 queue_utils.py:688] 2431.49M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_scoring_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1510 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.300183 78574 boto_utils.py:587] 2431.49M Found sqs_queue test_nagrawal_queue in cache PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.326695 78574 queue_utils.py:727] 2431.49M Queued processor message id=d05e2e95-4752-463a-b145-ad617aa183fa operations=['ai_interview_scoring_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.327099 78574 redis_utils.py:866] 2431.49M Redis delete key=ai_interview:ai_interview_eval_op_2e43cb8308c149229946386ff503fb6e_completed PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.334449 78574 redis_utils.py:866] 2431.49M Redis delete key=ai_interview:ai_interview_media_processing_op_2e43cb8308c149229946386ff503fb6e_completed PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.336149 78574 redis_utils.py:866] 2431.49M Redis delete key=ai_interview:ai_interview_feedback_generation_op_2e43cb8308c149229946386ff503fb6e_inprogress PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.338042 78574 queue_utils.py:73] 2431.49M Flushing batched messages index,eightfolddemo-voice-screening.com,test_nagrawal_queue 2 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.338709 78574 boto_utils.py:587] 2431.49M Found sqs_queue test_nagrawal_queue in cache PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.352793 78574 queue_utils.py:212] 2431.49M Deleting message 4e38a293-2823-43ff-a1e6-5aa7820704ea PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.362400 78574 request_tracelog.py:307] 2431.49M processor_test_nagrawal_queue: Total latency ms: 30153, Event latency ms: 1222, Num events: 62, Mem used: 3 MB, (Event, count, latency ms): [['ai_interview_feedback_generation_operation', {'num': 1, 'total_ms': 30128}], ['download_from_s3', {'num': 9, 'total_ms': 426}], ['firehose_flush', {'num': 6, 'total_ms': 200}], ['upload_to_s3', {'num': 3, 'total_ms': 109}], ['sqs_queue', {'num': 5, 'total_ms': 94}], ['ef_queue_send_message', {'num': 6, 'total_ms': 92}], ['prod_db_read', {'num': 24, 'total_ms': 59}], ['log_db_write', {'num': 3, 'total_ms': 50}], ['log_db_write_user_analytics', {'num': 3, 'total_ms': 50}], ['sequence_db_db_write', {'num': 3, 'total_ms': 43}]], Slowest 3 events [{'idx': 53, 'event': 'ai_interview_feedback_generation_operation', 'latency_ms': 30128.6, 'extra': '{"operations": ["ai_interview_feedback_generation_operation"], "_traceback": "truncated", "_parent_msg_id": "4d868914-7a04-45e4-aba1-31cf14de73af", "_parent_trace_id": "a7065381b21d45f58f86c46fa38632cb", "_message_dispatched_ts": 1759866549.2811134, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "air-freshly.created.agent@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'download_from_s3', 'latency_ms': 426, 'extra': {'num': 9}}, {'idx': -1, 'event': 'upload_to_s3', 'latency_ms': 109, 'extra': {'num': 3}}] PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.363061 78574 worker.py:759] 2431.49M Ending processing of message 4e38a293-2823-43ff-a1e6-5aa7820704ea latency: 30.16493034362793 PMID: a7065381b21d45f58f86c46fa38632cb SMID: 4e38a293-2823-43ff-a1e6-5aa7820704ea
I1007 19:54:28.365057 78574 worker.py:477] 2431.49M Starting processing of message f6ac7e12-5464-4385-9061-6e37eec1de0f received at 2025-10-07 19:53:47.000000 with timeout at 2025-10-07 20:23:47.000000
I1007 19:54:28.386130 78574 request_tracelog.py:76] 2431.49M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:54:28.400217 78574 worker.py:579] 2431.49M TimeToStart for first op ai_interview_feedback_generation_operation is: 41. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 3, 'total_ms': 4}], ['redis.set', {'num': 1, 'total_ms': 2}]]. PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.401012 78574 worker.py:598] 2431.49M Invoking preprocess for ai_interview_feedback_generation_operation op PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.401395 78574 worker.py:603] 2431.49M Invoking handle for ai_interview_feedback_generation_operation op PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.432898 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.476018 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.476969 78574 boto_utils.py:1049] 2431.49M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.509078 78574 session.py:414] 2431.49M Added debug log entry for session 77215, operation: ai_interview_feedback_generation_operation PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.509524 78574 ai_interview_feedback_generation_operation.py:47] 2431.49M Skipping code upload: not a coding interview or no coding questions present. group_id eightfolddemo-voice-screening.com, session_id 77215 PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.513255 78574 ai_interview_feedback_generation_operation.py:52] 2431.49M Skipping feedback generation for session 2e43cb8308c149229946386ff503fb6e because the eval and media processing operations have not completed PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.513646 78574 redis_utils.py:866] 2431.49M Redis delete key=ai_interview:ai_interview_feedback_generation_op_2e43cb8308c149229946386ff503fb6e_inprogress PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.516505 78574 queue_utils.py:212] 2431.49M Deleting message f6ac7e12-5464-4385-9061-6e37eec1de0f PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.526860 78574 request_tracelog.py:307] 2431.49M processor_test_nagrawal_queue: Total latency ms: 143, Event latency ms: 94, Num events: 7, Mem used: 0 MB, (Event, count, latency ms): [['ai_interview_feedback_generation_operation', {'num': 1, 'total_ms': 115}], ['download_from_s3', {'num': 2, 'total_ms': 47}], ['upload_to_s3', {'num': 1, 'total_ms': 32}], ['redis.get', {'num': 7, 'total_ms': 8}], ['redis.set', {'num': 2, 'total_ms': 4}], ['prod_db_read', {'num': 1, 'total_ms': 2}], ['prod_db_read_interview_session', {'num': 1, 'total_ms': 2}], ['redis.delete', {'num': 1, 'total_ms': 1}]], Slowest 3 events [{'idx': 1, 'event': 'ai_interview_feedback_generation_operation', 'latency_ms': 115.0, 'extra': '{"operations": ["ai_interview_feedback_generation_operation"], "_traceback": "truncated", "_parent_msg_id": "27138ec2-5e02-4372-ac01-14423a6d7038", "_parent_trace_id": "c988fa85abf84f1c8c759c337ffa2da6", "_message_dispatched_ts": 1759866825.2715883, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "air-freshly.created.agent@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'download_from_s3', 'latency_ms': 47, 'extra': {'num': 2}}, {'idx': -1, 'event': 'upload_to_s3', 'latency_ms': 32, 'extra': {'num': 1}}] PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.527333 78574 worker.py:759] 2431.49M Ending processing of message f6ac7e12-5464-4385-9061-6e37eec1de0f latency: 0.15780901908874512 PMID: c988fa85abf84f1c8c759c337ffa2da6 SMID: f6ac7e12-5464-4385-9061-6e37eec1de0f
I1007 19:54:28.530528 78574 worker.py:183] 2431.49M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:54:28.534454 78574 worker.py:275] 2431.49M Fetching messages from queue test_nagrawal_queue...
I1007 19:54:38.713162 78574 worker.py:297] 2431.49M Received 6 messages from queue test_nagrawal_queue with IDs: ['cc3c8335-e221-431f-aa9b-89b000f56a0c', 'fbec088f-3c86-4686-8159-dc99516d1700', '7f9aa7f2-a615-4ed5-b231-32d523adf736', 'd05e2e95-4752-463a-b145-ad617aa183fa', '7780c58e-252f-4f6b-bf42-6dc3d16b58ed', '0c024766-f9bb-40b9-808f-ad7e3c141ef1']
I1007 19:54:38.714037 78574 worker.py:477] 2431.49M Starting processing of message cc3c8335-e221-431f-aa9b-89b000f56a0c received at 2025-10-07 19:54:28.000000 with timeout at 2025-10-07 20:24:28.000000
I1007 19:54:38.716163 78574 request_tracelog.py:76] 2431.49M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:54:38.731649 78574 worker.py:579] 2431.49M TimeToStart for first op entity_index is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 4, 'total_ms': 4}], ['redis.set', {'num': 1, 'total_ms': 3}]]. PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.732246 78574 worker.py:598] 2431.49M Invoking preprocess for entity_index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.732947 78574 worker.py:603] 2431.49M Invoking handle for entity_index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.831351 78574 entity_index_operation.py:308] 2431.49M index_update_time for 12030704: 1759866879 PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.835614 78574 entity_index_operation.py:531] 2431.49M Solr batch add_to_index: 1 ec2-35-164-235-186.us-west-2.compute.amazonaws.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.854627 78574 entity_index_operation.py:531] 2431.49M Solr batch add_to_index: 1 ec2-35-91-247-119.us-west-2.compute.amazonaws.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
W1007 19:54:38.869117 78574 worker.py:621] 2431.49M Op handler return falsy status: None {'operations': ['entity_index'], '_traceback': '__EFCmPr-LZ4HC-B64::BCJNGGhAtQcAAAAAAADA9AIAAPNCICBGaWxlICIvaG9tZS9lYzItdXNlci92c2NvZGUvd3d3L3Byb2Nlc3Nvci9xdWV1ZV91dGlscy5weSIsIGxpbmUgNTgwLCBpbiBhZGRfdG9fLwBBaW5nXzAA8xQKICAgIHBheWxvYWRbJ190cmFjZWJhY2snXSA9IHRocmVhZFMA/w5jdXJyZW50X3N0YWNrKGNvbXByZXNzPVRydWUpCqgAD2BkYi9kYl9nACdlcp8AQTIyNzagAPEEdXBkYXRlX3NlYXJjaF9pbmRleJwACNYAD8QABC8oCicBEpBmaWxlX2ZlZWTgAA0RAAeUAEExNjg3lAABhgB1X3NoYXJlZCkAMF9hY34AUV9saXN0ogAFQgAPwwAALygpnAAxd19hY3Rpb26jADE0NTGiADZzYXYnAAGOAA3YAA/FAA4PPwER8A12b2ljZV9zY3JlZW5pbmcvc2VydmljZXMvaW50CwAlZXdbAAwsAAZ0AAM1AAhqAQP9ARlfyADeX2Zvcm1fYW5zd2Vyc9UABxEBCTcAD8gAaDEzNTPIAEpmaWxsxwABvwBfc2VsZi7kAAgvKAroAxk+YWlfrgBwX2dlbmVyYRYBM19vcAoAB6IAEjXSAlJoYW5kbPUDDc8ADr0ALygpmQAaSXdvcmvdAzE2MTV2AAMjAHJfbWVzc2FnfwCScmV0ID0gb3AukwDzCChyZXF1ZXN0LCBjdHhfYWZ0ZXJfcHJlOgBCLCBlZuwDD5IALCIzMjgDAdgENGFuZEwEBGYCCKcAEygIAAZ9ACIsIFEAU19jdHgsmgRXZ3JvdXCWBA+hACwvMTChAAMSXycBYF9leGNlcNwBA0UBCiYAESiUACJzPQcACK8AHj26AP8HcmVjZWl2ZV93YWl0X3RpbWVfbWFwPRwACACZAMlzdGFuY2VfdHlwZT0OAA/4ACwxODU5+AA+bWFp2wAPAQECHijlAC8sIL4ACg+wADoSN6gBgTxtb2R1bGU+tABwbWFpbigpCgAAAAA=', '_parent_msg_id': '4e38a293-2823-43ff-a1e6-5aa7820704ea', '_parent_trace_id': '8c015953b34a457984cb4b0481863d25', '_message_dispatched_ts': 1759866867.7701516, '_dispatch_host': '172.31.27.172', '_queue_name': 'index_requests', '_parent_queue_name': 'test_nagrawal_queue', '_interceptor_stack': [], '_workflow_recipe_ids': [], '_db_access_override_group_id': None, 'group_id': 'eightfolddemo-voice-screening.com', 'tablename': 'profile_feedback', 'entity_id': 12030704} PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.870711 78574 queue_utils.py:212] 2431.49M Deleting message cc3c8335-e221-431f-aa9b-89b000f56a0c PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.882128 78574 request_tracelog.py:307] 2431.49M processor_test_nagrawal_queue: Total latency ms: 167, Event latency ms: 75, Num events: 13, Mem used: 0 MB, (Event, count, latency ms): [['entity_index', {'num': 1, 'total_ms': 138}], ['redis.get', {'num': 27, 'total_ms': 29}], ['prod_db_read', {'num': 8, 'total_ms': 21}], ['prod_db_read_profile_feedback', {'num': 4, 'total_ms': 8}], ['prod_db_read_profile_data', {'num': 2, 'total_ms': 7}], ['request.ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 7}], ['redis.set', {'num': 2, 'total_ms': 6}], ['request.ec2-35-91-247-119.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 6}], ['prod_db_read_candidate_profiles', {'num': 1, 'total_ms': 3}], ['prod_db_read_sourcing_profiles', {'num': 1, 'total_ms': 3}]], Slowest 3 events [{'idx': 10, 'event': 'entity_index', 'latency_ms': 138.3, 'extra': '{"operations": ["entity_index"], "_traceback": "truncated", "_parent_msg_id": "4e38a293-2823-43ff-a1e6-5aa7820704ea", "_parent_trace_id": "8c015953b34a457984cb4b0481863d25", "_message_dispatched_ts": 1759866867.7701516, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "group_id": "eightfolddemo-voice-screening.com", "tablename": "profile_feedback", "entity_id": 12030704}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 29, 'extra': {'num': 27, 'config': 14, 'config_hash': 7, 'db_utils': 3, 'solr_indexing_pause': 2, 'firehose_config2': 1}}, {'idx': 8, 'event': 'request.ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000.post', 'latency_ms': 7.9, 'extra': '{"endpoint": "docs?overwrite=true&commitWithin=1000", "status": 200, "url": "http://ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000/solr/profile_feedback/update/json/doc (+34 chars)"}'}] PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.882713 78574 worker.py:759] 2431.49M Ending processing of message cc3c8335-e221-431f-aa9b-89b000f56a0c latency: 0.16393327713012695 PMID: 8c015953b34a457984cb4b0481863d25 SMID: cc3c8335-e221-431f-aa9b-89b000f56a0c
I1007 19:54:38.888415 78574 worker.py:477] 2431.49M Starting processing of message fbec088f-3c86-4686-8159-dc99516d1700 received at 2025-10-07 19:54:28.000000 with timeout at 2025-10-07 20:24:28.000000
I1007 19:54:38.894576 78574 request_tracelog.py:76] 2431.49M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: True and mem_profile: True
I1007 19:54:38.912742 78574 worker.py:579] 2431.49M TimeToStart for first op entity_index is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 7, 'total_ms': 8}], ['redis.set', {'num': 1, 'total_ms': 2}], ['redis.pipeline', {'num': 1, 'total_ms': 1}]]. PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:38.913312 78574 worker.py:598] 2431.49M Invoking preprocess for entity_index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:38.913768 78574 worker.py:603] 2431.49M Invoking handle for entity_index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.000475 78574 entity_index_operation.py:308] 2431.49M index_update_time for 12030704: 1759866879 PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.005703 78574 entity_index_operation.py:531] 2431.49M Solr batch add_to_index: 1 ec2-35-164-235-186.us-west-2.compute.amazonaws.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.011912 78574 entity_index_operation.py:531] 2431.49M Solr batch add_to_index: 1 ec2-35-91-247-119.us-west-2.compute.amazonaws.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
W1007 19:54:39.017744 78574 worker.py:621] 2431.49M Op handler return falsy status: None {'operations': ['entity_index'], '_traceback': '__EFCmPr-LZ4HC-B64::BCJNGGhA5QYAAAAAAACp1AIAAPNCICBGaWxlICIvaG9tZS9lYzItdXNlci92c2NvZGUvd3d3L3Byb2Nlc3Nvci9xdWV1ZV91dGlscy5weSIsIGxpbmUgNTgwLCBpbiBhZGRfdG9fLwBBaW5nXzAA8xQKICAgIHBheWxvYWRbJ190cmFjZWJhY2snXSA9IHRocmVhZFMA/w5jdXJyZW50X3N0YWNrKGNvbXByZXNzPVRydWUpCqgAD2BkYi9kYl9nACdlcp8AQTIyNzagAPEEdXBkYXRlX3NlYXJjaF9pbmRleJwACNYAD8QABB8ofwAoMTE4OH8AMnNhdgwBX3NlbGYujQAAEiiJAP8JbmFtZSwgY29tbWl0X2ltbWVkaWF0ZWx5AwER8A12b2ljZV9zY3JlZW5pbmcvc2VydmljZXMvaW50CwBwZXdfZmVlZH8BDCwABRkAE181AAfEADExODHDABBfxAAGKQDBZm9ybV9hbnN3ZXJz2gCwcHJvZmlsZV9mYi4qAB8oswBoMTM1M7MASmZpbGyyAAaEAQ/PAAgvKAoYAxk+YWlfrgDjX2dlbmVyYXRpb25fb3AKAAeiACE1N6EAUmhhbmRsGQINzwAOvQAvKCmZABpJd29ya44CMTYxNXYAAyMAcl9tZXNzYWd/AJJyZXQgPSBvcC6TAPMIKHJlcXVlc3QsIGN0eF9hZnRlcl9wcmU6AEIsIGVmHAMPkgAsIjMyXAIBCAQ0YW5kfAMEUQIIpwATKAgABn0AIiwgUQBTX2N0eCzKA1dncm91cMYDD6EALC8xMKEAAxJfJwFgX2V4Y2Vw3AEDRQEKJgAC1QMicz0HAAivAB49ugD/B3JlY2VpdmVfd2FpdF90aW1lX21hcD0cAAgAmQDJc3RhbmNlX3R5cGU9DgAP+AAsMTg1OfgAPm1hadsADwEBAh4o5QAvLCC+AAoPsAA6EjeoAYE8bW9kdWxlPrQAcG1haW4oKQoAAAAA', '_parent_msg_id': '4e38a293-2823-43ff-a1e6-5aa7820704ea', '_parent_trace_id': '8c015953b34a457984cb4b0481863d25', '_message_dispatched_ts': 1759866867.8762863, '_dispatch_host': '172.31.27.172', '_queue_name': 'index_requests', '_parent_queue_name': 'test_nagrawal_queue', '_interceptor_stack': ['prod:profile_feedback:12030704'], '_workflow_recipe_ids': [], '_db_access_override_group_id': None, 'group_id': 'eightfolddemo-voice-screening.com', 'tablename': 'profile_feedback', 'entity_id': 12030704} PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.018916 78574 queue_utils.py:212] 2431.49M Deleting message fbec088f-3c86-4686-8159-dc99516d1700 PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.027782 78574 worker.py:747] 2431.49M [OpLevelPerfStats] Op: entity_index. Performance Stats: {'CPUTime': 0, 'BlockingTime': 0, 'NonPatchedBlockingTime': 0, 'WallClockTime': 0.1363053321838379, 'WaitTime': 0.1363053321838379, 'TotalEventIOTime': 0.032, 'RSSMemUsed': 'NA'} PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.028604 78574 request_tracelog.py:307] 2431.49M processor_test_nagrawal_queue: Total latency ms: 137, Event latency ms: 59, Num events: 14, Mem used: 0 MB, (Event, count, latency ms): [['entity_index', {'num': 1, 'total_ms': 105}], ['prod_db_read', {'num': 8, 'total_ms': 24}], ['redis.get', {'num': 20, 'total_ms': 22}], ['prod_db_read_profile_feedback', {'num': 4, 'total_ms': 11}], ['prod_db_read_profile_data', {'num': 2, 'total_ms': 7}], ['redis.set', {'num': 2, 'total_ms': 4}], ['prod_db_read_sourcing_profiles', {'num': 1, 'total_ms': 4}], ['prod_db_read_candidate_profiles', {'num': 1, 'total_ms': 2}], ['redis.pipeline', {'num': 1, 'total_ms': 1}], ['request.ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 1}]], Slowest 3 events [{'idx': 10, 'event': 'entity_index', 'latency_ms': 105.4, 'extra': '{"operations": ["entity_index"], "_traceback": "truncated", "_parent_msg_id": "4e38a293-2823-43ff-a1e6-5aa7820704ea", "_parent_trace_id": "8c015953b34a457984cb4b0481863d25", "_message_dispatched_ts": 1759866867.8762863, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": ["prod:profile_feedback:12030704"], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "group_id": "eightfolddemo-voice-screening.com", "tablename": "profile_feedback", "entity_id": 12030704}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 22, 'extra': {'num': 20, 'config_hash': 17, 'config': 3}}, {'idx': 7, 'event': 'prod_db_read', 'latency_ms': 5.6, 'extra': '{"query": "SELECT * FROM profile_feedback WHERE (deleted_at IS NULL OR deleted_at IN (%s) ) AND group_id=%s AND (+64 chars)", "breakdowns": ["profile_feedback"], "retries": []}', 'rows_returned': 1}] PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.029284 78574 worker.py:759] 2431.49M Ending processing of message fbec088f-3c86-4686-8159-dc99516d1700 latency: 0.1362454891204834 PMID: 8c015953b34a457984cb4b0481863d25 SMID: fbec088f-3c86-4686-8159-dc99516d1700
I1007 19:54:39.031371 78574 worker.py:477] 2431.49M Starting processing of message 7f9aa7f2-a615-4ed5-b231-32d523adf736 received at 2025-10-07 19:54:28.000000 with timeout at 2025-10-07 20:24:28.000000
I1007 19:54:39.049653 78574 request_tracelog.py:76] 2431.49M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:54:39.061629 78574 worker.py:579] 2431.49M TimeToStart for first op ai_interview_feedback_eval_operation is: 11. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.set', {'num': 1, 'total_ms': 1}]]. PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.062365 78574 worker.py:598] 2431.49M Invoking preprocess for ai_interview_feedback_eval_operation op PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.062793 78574 worker.py:603] 2431.49M Invoking handle for ai_interview_feedback_eval_operation op PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.175099 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.214427 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.215654 78574 boto_utils.py:1049] 2431.49M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.277831 78574 session.py:414] 2431.49M Added debug log entry for session 77215, operation: ai_interview_feedback_eval_operation PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.313254 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.445670 78574 boto_utils.py:1256] 2431.49M Downloaded and returning files from S3. Bucket: vs-model-training, Files: air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/detailed_metric_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.447162 78574 ai_interview_db_log.py:109] 2431.49M Starting feedback quality evaluation for session 2e43cb8308c149229946386ff503fb6e PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.547451 78574 boto_utils.py:1256] 2432.62M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.569629 78574 boto_utils.py:1256] 2432.62M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.616156 78574 boto_utils.py:1256] 2432.62M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
W1007 19:54:39.617990 78574 transcript.py:160] 2432.74M Empty message for transcript item 15 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
W1007 19:54:39.618909 78574 transcript.py:160] 2432.74M Empty message for transcript item 15 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.656462 78574 llm_evaluation.py:141] 2432.74M Starting evaluate method with max_concurrent=10 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.657066 78574 async_utils.py:75] 2432.74M Created new event loop for task processing PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.657579 78574 async_utils.py:16] 2432.74M Starting 4 tasks with max_concurrent=10 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.658092 78574 llm_evaluation.py:59] 2432.74M Evaluating question 109194: Why do you want to work here? PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.658328 78574 llm_evaluation.py:62] 2432.74M Getting question 109194 from feedback template PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.658578 78574 llm_evaluation.py:69] 2432.74M Question type: text PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.658834 78574 llm_evaluation.py:73] 2432.74M Rating types: [<RatingType.FACTUAL_ACCURACY: 'factual_accuracy'>, <RatingType.COMPLETENESS: 'completeness'>, <RatingType.SNIPPET: 'snippet'>] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.659075 78574 llm_evaluation.py:77] 2432.74M Running LLM evaluation for question 109194 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.659296 78574 llm_evaluation.py:81] 2432.74M Calling acompose for question 109194 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.803286 78574 llm_evaluation.py:59] 2432.87M Evaluating question 109195: What are your long-term career plans? PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.803665 78574 llm_evaluation.py:62] 2432.87M Getting question 109195 from feedback template PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.804005 78574 llm_evaluation.py:69] 2432.87M Question type: text PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.804287 78574 llm_evaluation.py:73] 2432.87M Rating types: [<RatingType.FACTUAL_ACCURACY: 'factual_accuracy'>, <RatingType.COMPLETENESS: 'completeness'>, <RatingType.SNIPPET: 'snippet'>] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.804547 78574 llm_evaluation.py:77] 2432.87M Running LLM evaluation for question 109195 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.804994 78574 llm_evaluation.py:81] 2432.87M Calling acompose for question 109195 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.942134 78574 llm_evaluation.py:59] 2433.87M Evaluating question 110839: What is candidate's expected compensation? PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.942536 78574 llm_evaluation.py:62] 2433.87M Getting question 110839 from feedback template PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.942882 78574 llm_evaluation.py:69] 2433.87M Question type: text PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.943171 78574 llm_evaluation.py:73] 2433.87M Rating types: [<RatingType.FACTUAL_ACCURACY: 'factual_accuracy'>, <RatingType.COMPLETENESS: 'completeness'>, <RatingType.SNIPPET: 'snippet'>] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.943410 78574 llm_evaluation.py:77] 2433.87M Running LLM evaluation for question 110839 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:39.943641 78574 llm_evaluation.py:81] 2433.87M Calling acompose for question 110839 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:40.093424 78574 llm_evaluation.py:59] 2435.62M Evaluating question 109556: Would you recommend this candidate moves into the interview process? PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:40.093937 78574 llm_evaluation.py:62] 2435.62M Getting question 109556 from feedback template PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:40.094224 78574 llm_evaluation.py:69] 2435.62M Question type: thumbs_up_down_rating PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:40.094454 78574 llm_evaluation.py:73] 2435.62M Rating types: [<RatingType.SNIPPET: 'snippet'>] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:40.094679 78574 llm_evaluation.py:77] 2435.62M Running LLM evaluation for question 109556 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:40.094907 78574 llm_evaluation.py:81] 2435.62M Calling acompose for question 109556 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:44.266660 78574 _client.py:1786] 2437.99M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:44.278326 78574 llm_evaluation.py:93] 2437.99M acompose completed for question 110839 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:44.609735 78574 _client.py:1786] 2438.12M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:44.619707 78574 llm_evaluation.py:93] 2438.12M acompose completed for question 109194 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:45.201959 78574 _client.py:1786] 2438.12M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:45.209754 78574 llm_evaluation.py:93] 2438.12M acompose completed for question 109195 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.358701 78574 _client.py:1786] 2438.12M HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK" PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.366048 78574 llm_evaluation.py:93] 2438.12M acompose completed for question 109556 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.366635 78574 async_utils.py:46] 2438.12M Successfully completed 4/4 tasks PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.367716 78574 llm_evaluation.py:161] 2438.12M Completed evaluation with 4 evaluation results PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.370297 78574 ai_interview_db_log.py:73] 2438.12M Feedback evaluation completed successfully for session 2e43cb8308c149229946386ff503fb6e PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.377037 78574 firehose_utils.py:98] 2438.12M Publishing processor_event_log to firehose with 19 entries PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.467017 78574 queue_utils.py:212] 2438.24M Deleting message 7f9aa7f2-a615-4ed5-b231-32d523adf736 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.476321 78574 request_tracelog.py:307] 2438.24M processor_test_nagrawal_queue: Total latency ms: 7429, Event latency ms: 547, Num events: 23, Mem used: 6 MB, (Event, count, latency ms): [['ai_interview_feedback_eval_operation', {'num': 1, 'total_ms': 7404}], ['download_from_s3', {'num': 7, 'total_ms': 314}], ['firehose_flush', {'num': 1, 'total_ms': 88}], ['upload_to_s3', {'num': 1, 'total_ms': 62}], ['prod_db_read', {'num': 13, 'total_ms': 47}], ['prod_db_read_profile_feedback', {'num': 2, 'total_ms': 13}], ['prod0_db_read', {'num': 4, 'total_ms': 12}], ['redis.get', {'num': 11, 'total_ms': 11}], ['prod_db_read_user_login', {'num': 2, 'total_ms': 9}], ['prod_db_read_user_calendar_events', {'num': 1, 'total_ms': 8}]], Slowest 3 events [{'idx': 18, 'event': 'ai_interview_feedback_eval_operation', 'latency_ms': 7404.6, 'extra': '{"operations": ["ai_interview_feedback_eval_operation"], "_traceback": "truncated", "_parent_msg_id": "4e38a293-2823-43ff-a1e6-5aa7820704ea", "_parent_trace_id": "8c015953b34a457984cb4b0481863d25", "_message_dispatched_ts": 1759866868.2777493, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "import@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215, "save_to_db": true}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'download_from_s3', 'latency_ms': 314, 'extra': {'num': 7}}, {'idx': 17, 'event': 'firehose_flush', 'latency_ms': 88.4, 'extra': '{"stream": "processor_event_log", "num": 19}'}] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
I1007 19:54:46.476988 78574 worker.py:759] 2438.24M Ending processing of message 7f9aa7f2-a615-4ed5-b231-32d523adf736 latency: 7.441248893737793 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7f9aa7f2-a615-4ed5-b231-32d523adf736
E1007 19:54:46.477818 78574 counters.py:319] 2438.24M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:54:46.479348 78574 worker.py:477] 2438.24M Starting processing of message d05e2e95-4752-463a-b145-ad617aa183fa received at 2025-10-07 19:54:28.000000 with timeout at 2025-10-07 20:24:28.000000
I1007 19:54:46.497112 78574 request_tracelog.py:76] 2438.24M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:54:46.508767 78574 worker.py:579] 2438.24M TimeToStart for first op ai_interview_scoring_operation is: 18. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.set', {'num': 1, 'total_ms': 2}], ['redis.get', {'num': 1, 'total_ms': 1}]]. PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.509391 78574 worker.py:598] 2438.24M Invoking preprocess for ai_interview_scoring_operation op PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.521308 78574 worker.py:603] 2438.24M Invoking handle for ai_interview_scoring_operation op PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.652234 78574 boto_utils.py:1256] 2438.24M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/interview_sessions/eightfolddemo-voice-screening.com/2e43cb8308c149229946386ff503fb6e.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.690411 78574 boto_utils.py:1256] 2438.24M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.691251 78574 boto_utils.py:1049] 2438.24M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.722037 78574 session.py:414] 2438.24M Added debug log entry for session 77215, operation: ai_interview_scoring_operation PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.774084 78574 boto_utils.py:1256] 2438.24M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/elevenlabs_conversation_details/eightfolddemo-voice-screening.com/66412.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
W1007 19:54:46.776189 78574 transcript.py:160] 2438.24M Empty message for transcript item 15 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
W1007 19:54:46.776779 78574 transcript.py:160] 2438.24M Empty message for transcript item 15 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:46.782828 78574 candidate.py:1421] 2438.24M Overwrite call made with source:default, columns:['data_json'], modified_fields:[] PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.065141 78574 firehose_utils.py:98] 2440.37M Publishing candidate_profiles_changelog to firehose with 1 entries PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.082596 78574 profile_highlight_interceptor.py:44] 2440.37M Skipping Profile Highlight operation as profile exp data is same, profile_id: 473031799 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.192271 78574 boto_utils.py:1256] 2440.37M Downloaded and returning files from S3. Bucket: vs-model-training, Files: air_eval/eval_profile_screening_v1_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107/detailed_metric_473031799_27983252_2e43cb8308c149229946386ff503fb6e_1759866107.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.194553 78574 ai_interview_scoring_operation.py:112] 2440.37M [AI Interview Scoring] Interview session 2e43cb8308c149229946386ff503fb6e, group_id: eightfolddemo-voice-screening.com is too short, skipping scoring PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.203236 78574 queue_utils.py:688] 2440.37M Requesting worker processing for queue:test_nagrawal_queue op:['index'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1627 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.203955 78574 queue_utils.py:699] 2440.37M Message added for batching ['index'] eightfolddemo-voice-screening.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.204628 78574 ai_interview_queueing_service.py:21] 2440.37M [AIInterviewQueueingService] Queueing ai_interview_feedback_email_send_operation for self.interview_session_rds=<InterviewSession id=77215 group_id=eightfolddemo-voice-screening.com> PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.209079 78574 queue_utils.py:688] 2440.37M Requesting worker processing for queue:test_nagrawal_queue op:['ai_interview_feedback_email_send_operation'] group_id:eightfolddemo-voice-screening.com delay:0 payload size:1587 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.209567 78574 boto_utils.py:587] 2440.37M Found sqs_queue test_nagrawal_queue in cache PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.224000 78574 queue_utils.py:727] 2440.37M Queued processor message id=3616c56f-fa60-43fc-b1eb-08e6dcbadd00 operations=['ai_interview_feedback_email_send_operation'] with message_group_id=None to queue=test_nagrawal_queue PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.224892 78574 queue_utils.py:73] 2440.37M Flushing batched messages index,eightfolddemo-voice-screening.com,test_nagrawal_queue 1 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.225577 78574 boto_utils.py:587] 2440.37M Found sqs_queue test_nagrawal_queue in cache PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.242524 78574 queue_utils.py:212] 2440.37M Deleting message d05e2e95-4752-463a-b145-ad617aa183fa PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.252055 78574 request_tracelog.py:307] 2440.37M processor_test_nagrawal_queue: Total latency ms: 757, Event latency ms: 475, Num events: 30, Mem used: 2 MB, (Event, count, latency ms): [['ai_interview_scoring_operation', {'num': 1, 'total_ms': 732}], ['download_from_s3', {'num': 4, 'total_ms': 261}], ['redis.get', {'num': 38, 'total_ms': 42}], ['upload_to_s3', {'num': 1, 'total_ms': 30}], ['ef_queue_send_message', {'num': 2, 'total_ms': 26}], ['redis.set', {'num': 9, 'total_ms': 20}], ['prod_db_read', {'num': 8, 'total_ms': 18}], ['prod0_db_read', {'num': 5, 'total_ms': 17}], ['sqs_queue', {'num': 1, 'total_ms': 17}], ['firehose_flush', {'num': 1, 'total_ms': 14}]], Slowest 3 events [{'idx': 21, 'event': 'ai_interview_scoring_operation', 'latency_ms': 733.0, 'extra': '{"operations": ["ai_interview_scoring_operation"], "_traceback": "truncated", "_parent_msg_id": "4e38a293-2823-43ff-a1e6-5aa7820704ea", "_parent_trace_id": "8c015953b34a457984cb4b0481863d25", "_message_dispatched_ts": 1759866868.294854, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "import@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'download_from_s3', 'latency_ms': 261, 'extra': {'num': 4}}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 42, 'extra': {'num': 38, 'config_hash': 17, 'config': 17, 'db_utils': 3, 'app_platform_app_triggers': 1}}] PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.252748 78574 worker.py:759] 2440.37M Ending processing of message d05e2e95-4752-463a-b145-ad617aa183fa latency: 0.7693016529083252 PMID: 8c015953b34a457984cb4b0481863d25 SMID: d05e2e95-4752-463a-b145-ad617aa183fa
I1007 19:54:47.254344 78574 worker.py:477] 2440.37M Starting processing of message 7780c58e-252f-4f6b-bf42-6dc3d16b58ed received at 2025-10-07 19:54:28.000000 with timeout at 2025-10-07 20:24:28.000000
I1007 19:54:47.274373 78574 request_tracelog.py:76] 2440.37M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:54:47.290434 78574 worker.py:579] 2440.37M TimeToStart for first op index is: 19. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 5, 'total_ms': 5}], ['redis.set', {'num': 1, 'total_ms': 3}], ['redis.pipeline', {'num': 1, 'total_ms': 2}]]. PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.291022 78574 worker.py:598] 2440.37M Invoking preprocess for index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.291422 78574 worker.py:603] 2440.37M Invoking handle for index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.295313 78574 index_operation.py:619] 2440.37M start processing 1 profiles including 0 dupes PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.315909 78574 index_operation.py:273] 2440.37M batch_num 1 profiles_loaded: 1 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.344834 78574 db_connection.py:646] 2440.37M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'prod' 'read' 0 'utf8mb4' 'mysql+pymysql:xxxx@shared-prod-cluster-0.cluster-ro-cdadnhflbn18.us-west-2.rds.amazonaws.com/vsdb?charset=utf8mb4'> PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.413729 78574 db_connection.py:646] 2440.37M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'log' 'read' 0 'utf8mb4' 'mysql+pymysql:xxxx@shared-feature-cluster-0.cluster-ro-cdadnhflbn18.us-west-2.rds.amazonaws.com/vscrawldatadb?charset=utf8mb4'> PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.448154 78574 index_operation.py:300] 2440.37M loaded entities for 1 profiles, {'profile_notes': 0, 'profile_tags': 2, 'event_candidate_activity': 0, 'profile_feedback': 1, 'profile_data': 2, 'scheduled_operation': 1, 'index_op_cached_data': 1} PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.456997 78574 indexed_profile.py:142] 2440.37M index_update_time for 473031799: 1759866887 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
W1007 19:54:47.538717 78574 phone_utils.py:67] 2440.37M Could not extract phone number without country code from  as (1) The string supplied did not seem to be a phone number. PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
W1007 19:54:47.634184 78574 time_utils.py:251] 2440.37M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
W1007 19:54:47.638242 78574 time_utils.py:251] 2440.37M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.648033 78574 entity_objects.py:377] 2440.37M Fetched entities={'acme_markets': <EntityObjects: 'acmemarkets.com' 'Acme Markets'>} from cache for name(s)=Acme PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.649166 78574 entity_objects.py:377] 2440.37M Fetched entities={'microsoft': <EntityObjects: 'microsoft.com' 'Microsoft'>, 'google': <EntityObjects: 'google.com' 'Google'>} from cache for name(s)=['Microsoft', 'Google'] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:47.675344 78574 db_connection.py:646] 2440.37M [db-connection] Connect event: Enabling READ COMMITTED <ConnectionContext: 'feature' 'read' 0 'utf8mb4' 'mysql+pymysql:xxxx@proxy-vsfeaturedb-ro.endpoint.proxy-cdadnhflbn18.us-west-2.rds.amazonaws.com/featuredb?charset=utf8mb4'> PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
W1007 19:54:48.137833 78574 profile_data.py:318] 2441.37M Trying to load data for a namespace 'integrations_assessment' that this group_id 'eightfolddemo-voice-screening.com' doesn't have access to PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
W1007 19:54:48.138409 78574 profile_data.py:318] 2441.37M Trying to load data for a namespace 'integrations_interview' that this group_id 'eightfolddemo-voice-screening.com' doesn't have access to PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.308605 78574 profile_index_service.py:55] 2441.37M No employee email found for profile 473031799 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.387485 78574 profile.py:1465] 2444.24M Profile id is not valid: None PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.593660 78574 index_operation.py:504] 2444.24M Time taken to index 1 profiles: 1298.5246181488037 ms PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.594552 78574 queue_utils.py:212] 2444.24M Deleting message 7780c58e-252f-4f6b-bf42-6dc3d16b58ed PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.605480 78574 request_tracelog.py:307] 2444.24M processor_test_nagrawal_queue: Total latency ms: 1333, Event latency ms: 559, Num events: 122, Mem used: 3 MB, (Event, count, latency ms): [['index', {'num': 1, 'total_ms': 1303}], ['prod_db_read', {'num': 81, 'total_ms': 240}], ['redis.get', {'num': 121, 'total_ms': 131}], ['prod_db_read_profile_tags', {'num': 11, 'total_ms': 39}], ['log_db_read', {'num': 14, 'total_ms': 38}], ['prod_db_read_profile_data', {'num': 12, 'total_ms': 33}], ['redis.set', {'num': 22, 'total_ms': 29}], ['prod0_db_read', {'num': 6, 'total_ms': 28}], ['prod_db_read_entity_profile_applications', {'num': 4, 'total_ms': 21}], ['prod_db_read_user_login', {'num': 7, 'total_ms': 20}]], Slowest 3 events [{'idx': 117, 'event': 'index', 'latency_ms': 1303.5, 'extra': '{"operations": ["index"], "_traceback": "truncated", "_parent_msg_id": "4e38a293-2823-43ff-a1e6-5aa7820704ea", "_parent_trace_id": "8c015953b34a457984cb4b0481863d25", "_message_dispatched_ts": 1759866868.1920867, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": ["prod:interview_session:77215"], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "air-freshly.created.agent@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "profile_id": [473031799, 473031799], "num_profiles": 1}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 131, 'extra': {'num': 121, 'config': 68, 'config_hash': 25, 'db_utils': 23, 'profile_utils': 1, 'title_tenure_data': 1, 'custom_field_registry_group_id': 1, '{instant_docs}': 1, 'solr_indexing_pause': 1}}, {'idx': -1, 'event': 'redis.set', 'latency_ms': 29, 'extra': {'num': 22, 'config': 8, 'db_utils': 5, 'config_hash': 3, '{processor_worker}': 2, 'profile_utils': 1, '{next_vector_title_16:eightfolddemo-voice-screening.com}': 1, '{next_vector_work_15:eightfolddemo-voice-screening.com}': 1, '{bert_vector_profile_5:eightfolddemo-voice-screening.com}': 1}}] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.606046 78574 worker.py:759] 2444.24M Ending processing of message 7780c58e-252f-4f6b-bf42-6dc3d16b58ed latency: 1.3470451831817627 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 7780c58e-252f-4f6b-bf42-6dc3d16b58ed
I1007 19:54:48.608851 78574 worker.py:477] 2444.24M Starting processing of message 0c024766-f9bb-40b9-808f-ad7e3c141ef1 received at 2025-10-07 19:54:28.000000 with timeout at 2025-10-07 20:24:28.000000
I1007 19:54:48.613849 78574 request_tracelog.py:76] 2444.24M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: True and mem_profile: True
I1007 19:54:48.632634 78574 worker.py:579] 2444.24M TimeToStart for first op entity_index is: 20. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 3, 'total_ms': 3}], ['redis.set', {'num': 1, 'total_ms': 2}]]. PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.633286 78574 worker.py:598] 2444.24M Invoking preprocess for entity_index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.633889 78574 worker.py:603] 2444.24M Invoking handle for entity_index op PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.705552 78574 entity_index_operation.py:308] 2444.24M index_update_time for 12030704: 1759866889 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.709079 78574 entity_index_operation.py:531] 2444.24M Solr batch add_to_index: 1 ec2-35-164-235-186.us-west-2.compute.amazonaws.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.716849 78574 entity_index_operation.py:531] 2444.24M Solr batch add_to_index: 1 ec2-35-91-247-119.us-west-2.compute.amazonaws.com PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
W1007 19:54:48.722811 78574 worker.py:621] 2444.24M Op handler return falsy status: None {'operations': ['entity_index'], '_traceback': '__EFCmPr-LZ4HC-B64::BCJNGGhAHwgAAAAAAAD0HwMAAPNCICBGaWxlICIvaG9tZS9lYzItdXNlci92c2NvZGUvd3d3L3Byb2Nlc3Nvci9xdWV1ZV91dGlscy5weSIsIGxpbmUgNTgwLCBpbiBhZGRfdG9fLwBBaW5nXzAA8xQKICAgIHBheWxvYWRbJ190cmFjZWJhY2snXSA9IHRocmVhZFMA/w5jdXJyZW50X3N0YWNrKGNvbXByZXNzPVRydWUpCqgAD2BkYi9kYl9nACdlcp8AQTIyNzagAPEEdXBkYXRlX3NlYXJjaF9pbmRleJwACNYAD8QABB8ofwAoMTE4OH8AMnNhdgwBX3NlbGYujQAAEiiJAP8LbmFtZSwgY29tbWl0X2ltbWVkaWF0ZWx5KQqrARKQZmlsZV9mZWVkZAENEQAHmQA6OTMwmAAFLAAgYi4UAJ8oKiprd2FyZ3N5ADJ3X2FjdGlvboAANTQ0OYAABScACokABLUAAY8ABp8AJCwgKgIAhwAYPQ0AD6wAEfANdm9pY2Vfc2NyZWVuaW5nL3NlcnZpY2VzL2ludAsAJmV3xwALLAAGzwADNQAH0AATMWcCGV/RAN5fZm9ybV9hbnN3ZXJz3gAHGgEJNwAfKMgAZzEzNTPIAEpmaWxsxwAGvgIP5AAILygKUgQZPmFpX64AcF9nZW5lcmEWATNfb3AKAAeiACE1N6EAUmhhbmRsuwINzwAOvQAvKCmZABpJd29ya8gDMTYxNXYAAyMAcl9tZXNzYWd/AJJyZXQgPSBvcC6TAPMIKHJlcXVlc3QsIGN0eF9hZnRlcl9wcmU6AEIsIGVmVgQPkgAsMTMyMZIAAUIFNGFuZLYEBGYCCKcAEygIAAZ9ACIsIFEAU19jdHgsBAVXZ3JvdXAABQ+hACwvMTChAAMSXycBYF9leGNlcNwBA0UBCiYAAg8FInM9BwAIrwAePboA/wdyZWNlaXZlX3dhaXRfdGltZV9tYXA9HAAIAJkAyXN0YW5jZV90eXBlPQ4AD/gALCI4NdoEPm1hadsADwEBAh4o5QAvLCC+AAoPsAA6EjeoAYE8bW9kdWxlPrQAcG1haW4oKQoAAAAA', '_parent_msg_id': '4e38a293-2823-43ff-a1e6-5aa7820704ea', '_parent_trace_id': '8c015953b34a457984cb4b0481863d25', '_message_dispatched_ts': 1759866867.7074842, '_dispatch_host': '172.31.27.172', '_queue_name': 'index_requests', '_parent_queue_name': 'test_nagrawal_queue', '_interceptor_stack': ['prod:profile_feedback:12030704'], '_workflow_recipe_ids': [], '_db_access_override_group_id': None, 'group_id': 'eightfolddemo-voice-screening.com', 'tablename': 'profile_feedback', 'entity_id': 12030704} PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.723654 78574 queue_utils.py:212] 2444.24M Deleting message 0c024766-f9bb-40b9-808f-ad7e3c141ef1 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.731892 78574 worker.py:747] 2444.24M [OpLevelPerfStats] Op: entity_index. Performance Stats: {'CPUTime': 0, 'BlockingTime': 0, 'NonPatchedBlockingTime': 0, 'WallClockTime': 0.12076997756958008, 'WaitTime': 0.12076997756958008, 'TotalEventIOTime': 0.03, 'RSSMemUsed': 'NA'} PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.732660 78574 request_tracelog.py:307] 2444.24M processor_test_nagrawal_queue: Total latency ms: 121, Event latency ms: 40, Num events: 13, Mem used: 0 MB, (Event, count, latency ms): [['entity_index', {'num': 1, 'total_ms': 90}], ['prod_db_read', {'num': 8, 'total_ms': 20}], ['prod_db_read_profile_feedback', {'num': 4, 'total_ms': 10}], ['redis.get', {'num': 6, 'total_ms': 6}], ['redis.set', {'num': 2, 'total_ms': 4}], ['prod_db_read_profile_data', {'num': 2, 'total_ms': 4}], ['request.ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 4}], ['prod_db_read_candidate_profiles', {'num': 1, 'total_ms': 3}], ['prod_db_read_sourcing_profiles', {'num': 1, 'total_ms': 3}], ['request.ec2-35-91-247-119.us-west-2.compute.amazonaws.com:8000.post', {'num': 1, 'total_ms': 2}]], Slowest 3 events [{'idx': 10, 'event': 'entity_index', 'latency_ms': 90.4, 'extra': '{"operations": ["entity_index"], "_traceback": "truncated", "_parent_msg_id": "4e38a293-2823-43ff-a1e6-5aa7820704ea", "_parent_trace_id": "8c015953b34a457984cb4b0481863d25", "_message_dispatched_ts": 1759866867.7074842, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": ["prod:profile_feedback:12030704"], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "group_id": "eightfolddemo-voice-screening.com", "tablename": "profile_feedback", "entity_id": 12030704}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 6, 'extra': {'num': 6, 'config_hash': 4, 'config': 2}}, {'idx': 8, 'event': 'request.ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000.post', 'latency_ms': 4.2, 'extra': '{"endpoint": "docs?overwrite=true&commitWithin=1000", "status": 200, "url": "http://ec2-35-164-235-186.us-west-2.compute.amazonaws.com:8000/solr/profile_feedback/update/json/doc (+34 chars)"}'}] PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.733459 78574 worker.py:759] 2444.24M Ending processing of message 0c024766-f9bb-40b9-808f-ad7e3c141ef1 latency: 0.1203012466430664 PMID: 8c015953b34a457984cb4b0481863d25 SMID: 0c024766-f9bb-40b9-808f-ad7e3c141ef1
I1007 19:54:48.736339 78574 worker.py:183] 2444.24M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:54:48.740558 78574 worker.py:275] 2444.24M Fetching messages from queue test_nagrawal_queue...
I1007 19:54:58.821560 78574 worker.py:297] 2444.24M Received 2 messages from queue test_nagrawal_queue with IDs: ['03206918-3974-438a-a125-66dc595c43c2', '3616c56f-fa60-43fc-b1eb-08e6dcbadd00']
I1007 19:54:58.823184 78574 worker.py:477] 2444.24M Starting processing of message 03206918-3974-438a-a125-66dc595c43c2 received at 2025-10-07 19:54:48.000000 with timeout at 2025-10-07 20:24:48.000000
I1007 19:54:58.830318 78574 request_tracelog.py:76] 2444.24M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:54:58.839508 78574 firehose_utils.py:98] 2444.24M Publishing db_query_log to firehose with 10 entries PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.927315 78574 firehose_utils.py:98] 2444.24M Publishing etl_entity_log to firehose with 6 entries PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.941061 78574 firehose_utils.py:98] 2444.24M Publishing user_analytics to firehose with 3 entries PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.963399 78574 worker.py:579] 2444.24M TimeToStart for first op index is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['firehose_flush', {'num': 3, 'total_ms': 109}], ['redis.get', {'num': 4, 'total_ms': 4}], ['redis.set', {'num': 1, 'total_ms': 3}]]. PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.964074 78574 worker.py:598] 2444.24M Invoking preprocess for index op PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.964761 78574 worker.py:603] 2444.24M Invoking handle for index op PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.978051 78574 index_operation.py:619] 2444.24M start processing 1 profiles including 0 dupes PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:58.999922 78574 index_operation.py:273] 2444.24M batch_num 1 profiles_loaded: 1 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.083927 78574 index_operation.py:300] 2444.24M loaded entities for 1 profiles, {'profile_notes': 0, 'profile_tags': 2, 'event_candidate_activity': 0, 'profile_feedback': 1, 'profile_data': 2, 'scheduled_operation': 1, 'index_op_cached_data': 1} PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.091579 78574 indexed_profile.py:142] 2444.24M index_update_time for 473031799: 1759866899 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
W1007 19:54:59.123574 78574 phone_utils.py:67] 2444.24M Could not extract phone number without country code from  as (1) The string supplied did not seem to be a phone number. PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
W1007 19:54:59.182081 78574 time_utils.py:251] 2444.24M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
W1007 19:54:59.185438 78574 time_utils.py:251] 2444.24M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.193098 78574 entity_objects.py:377] 2444.24M Fetched entities={'acme_markets': <EntityObjects: 'acmemarkets.com' 'Acme Markets'>} from cache for name(s)=Acme PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.193581 78574 entity_objects.py:377] 2444.24M Fetched entities={'microsoft': <EntityObjects: 'microsoft.com' 'Microsoft'>, 'google': <EntityObjects: 'google.com' 'Google'>} from cache for name(s)=['Microsoft', 'Google'] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
W1007 19:54:59.661507 78574 profile_data.py:318] 2444.24M Trying to load data for a namespace 'integrations_assessment' that this group_id 'eightfolddemo-voice-screening.com' doesn't have access to PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
W1007 19:54:59.662449 78574 profile_data.py:318] 2444.24M Trying to load data for a namespace 'integrations_interview' that this group_id 'eightfolddemo-voice-screening.com' doesn't have access to PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.780723 78574 ranking_service_client.py:116] 2444.24M Fetching score_profile_legacy. profile <Profile: 473031799 'eightfolddemo-voice-screening.com' 'Rachel Phelps'>. calibration <position.calibration.Calibration object at 0x72ab56cf4190> PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
W1007 19:54:59.794094 78574 time_utils.py:251] 2444.24M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.807233 78574 redis_utils.py:172] 2444.24M Creating redis connection for persist_prod to red1k2ybk2jy5de0.lspxxu.clustercfg.usw2.cache.amazonaws.com PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.979176 78574 score_profile.py:666] 2448.37M Latency waterfall (default 0): [('overall', 0.196), ('sp_init', 0.087), ('sp_init_appl', 0.086), ('sp_init_skills', 0.041), ('sp_init_db_lookup_ts', 0.032), ('post_bdt_score_helper', 0.025), ('interview_features', 0.015), ('skill', 0.011), ('pass1_filter', 0.01), ('ada_features', 0.009), ('lang', 0.008), ('score_helper', 0.008), ('sp_init_title', 0.007), ('demand_experiences', 0.006), ('bdt_overall', 0.006), ('final_score_with_bdt', 0.006), ('bdt_extract_features', 0.003), ('title', 0.002), ('location', 0.002), ('current_title', 0.001), ('sp_init_load_sc', 0.001), ('update_translations_ts', 0.001)] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:54:59.994203 78574 profile_index_service.py:55] 2448.37M No employee email found for profile 473031799 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:55:00.154088 78574 profile.py:1465] 2450.62M Profile id is not valid: None PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:55:00.483440 78574 index_operation.py:504] 2450.62M Time taken to index 1 profiles: 1516.0636901855469 ms PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:55:00.485033 78574 queue_utils.py:212] 2450.62M Deleting message 03206918-3974-438a-a125-66dc595c43c2 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:55:00.497628 78574 request_tracelog.py:307] 2450.62M processor_test_nagrawal_queue: Total latency ms: 1672, Event latency ms: 896, Num events: 115, Mem used: 6 MB, (Event, count, latency ms): [['index', {'num': 1, 'total_ms': 1520}], ['prod_db_read', {'num': 78, 'total_ms': 228}], ['score_profile', {'num': 1, 'total_ms': 196}], ['redis.get', {'num': 115, 'total_ms': 192}], ['firehose_flush', {'num': 3, 'total_ms': 109}], ['log_db_read', {'num': 12, 'total_ms': 40}], ['prod_db_read_user_messages', {'num': 4, 'total_ms': 35}], ['prod_db_read_profile_data', {'num': 12, 'total_ms': 33}], ['prod_db_read_event_candidate_activity', {'num': 10, 'total_ms': 27}], ['prod_db_read_profile_tags', {'num': 11, 'total_ms': 25}]], Slowest 3 events [{'idx': 110, 'event': 'index', 'latency_ms': 1520.8, 'extra': '{"operations": ["index"], "_traceback": "truncated", "_parent_msg_id": "d05e2e95-4752-463a-b145-ad617aa183fa", "_parent_trace_id": "5579d52321834802b1defcef73fa4a60", "_message_dispatched_ts": 1759866887.2011638, "_dispatch_host": "172.31.27.172", "_queue_name": "index_requests", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "group_id": "eightfolddemo-voice-screening.com", "profile_id": "473031799", "num_profiles": 1, "reindex_dupes": true, "profile_update_recompute_match_star": true}', 'is_aggregate_event': True}, {'idx': 85, 'event': 'score_profile', 'latency_ms': 196.0, 'extra': '{"key": "473031799:27983252:668038332782863977:False:True:-5337076844874347489:-1284072931640910250"}'}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 192, 'extra': {'num': 115, 'config_hash': 56, 'config': 51, 'custom_field_registry_group_id': 2, 'solr_indexing_pause': 2, 'profile_utils': 1, 'log': 1, 'position_jd_lang': 1, 'geocode': 1}}] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:55:00.498584 78574 worker.py:759] 2450.62M Ending processing of message 03206918-3974-438a-a125-66dc595c43c2 latency: 1.6680793762207031 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 03206918-3974-438a-a125-66dc595c43c2
I1007 19:55:00.502203 78574 worker.py:477] 2450.62M Starting processing of message 3616c56f-fa60-43fc-b1eb-08e6dcbadd00 received at 2025-10-07 19:54:48.000000 with timeout at 2025-10-07 20:24:48.000000
I1007 19:55:00.521995 78574 request_tracelog.py:76] 2450.62M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:55:00.536960 78574 worker.py:579] 2450.62M TimeToStart for first op ai_interview_feedback_email_send_operation is: 12. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 5, 'total_ms': 5}], ['redis.set', {'num': 1, 'total_ms': 3}], ['redis.pipeline', {'num': 1, 'total_ms': 1}]]. PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:00.537636 78574 worker.py:598] 2450.62M Invoking preprocess for ai_interview_feedback_email_send_operation op PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:00.538182 78574 worker.py:603] 2450.62M Invoking handle for ai_interview_feedback_email_send_operation op PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:00.629240 78574 boto_utils.py:1256] 2450.62M Downloaded and returning files from S3. Bucket: vs-crawldata, Files: ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json, Cache Hits: 0, Cache Misses: 1, Cache Hit %: 0.00%, Cache Miss %: 100.00% PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:00.630121 78574 boto_utils.py:1049] 2450.62M Uploading file to s3://vs-crawldata/ai_recruiter/processor_event_logs/eightfolddemo-voice-screening.com/77215.json PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:00.686936 78574 session.py:414] 2450.62M Added debug log entry for session 77215, operation: ai_interview_feedback_email_send_operation PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.004781 78574 firehose_utils.py:98] 2453.12M Publishing user_messages_changelog to firehose with 1 entries PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.031123 78574 boto_utils.py:1049] 2453.12M Uploading file to s3://vs-crawldata/user_messages/eightfolddemo-voice-screening.com/556121656 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.416486 78574 firehose_utils.py:98] 2453.62M Publishing user_email_templates_changelog to firehose with 1 entries PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.495589 78574 email_utils.py:257] 2453.74M Redirecting demo and sandbox emails - ['demo@eightfolddemo-voice-screening.com'] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.500616 78574 email_utils.py:341] 2453.74M Addresses after redirecting demo and sandbox emails - ['demo@eightfold.ai'] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.501297 78574 email_utils.py:389] 2453.74M filtering destinations ['demo@eightfold.ai'] against feedbacks - ['bounce'] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.603715 78574 email_utils.py:392] 2453.74M Destinations after filtering against feedbacks ['bounce'] - ['demo@eightfold.ai'] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:02.858253 78574 email_client.py:47] 2454.74M [send_email][group_id:eightfolddemo-voice-screening.com] Email sent to: ['demo@eightfold.ai'], from: "Import eightfolddemo-voice-screening.com" <import@eightfolddemo-voice-screening.efsend.com> reply_to: ['"Import eightfolddemo-voice-screening.com" <import@eightfolddemo-voice-screening.com>'], is_html: True, subject: Review screening feedback for Rachel Phelps, body len: 12677, resp: {'MessageId': '01010199c03dd8e0-97849714-2f56-4931-8b38-e650ac017c14-000000', 'ResponseMetadata': {'RequestId': '3f8b7385-68b7-484f-9d4d-50d2f26b5d10', 'HTTPStatusCode': 200, 'HTTPHeaders': {'date': 'Tue, 07 Oct 2025 19:55:02 GMT', 'content-type': 'text/xml', 'content-length': '326', 'connection': 'keep-alive', 'x-amzn-requestid': '3f8b7385-68b7-484f-9d4d-50d2f26b5d10'}, 'RetryAttempts': 0}} PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:03.016225 78574 firehose_utils.py:98] 2455.12M Publishing user_messages_changelog to firehose with 1 entries PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
W1007 19:55:03.037464 78574 slack_message_utils.py:48] 2455.12M Skipping Slack message, no body found for template category ta_review_ai_feedback and channel slack PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
W1007 19:55:03.084071 78574 app_platform_message_utils.py:33] 2455.12M No app installed for user: import@eightfolddemo-voice-screening.com PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:03.089649 78574 queue_utils.py:212] 2455.12M Deleting message 3616c56f-fa60-43fc-b1eb-08e6dcbadd00 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:03.101816 78574 request_tracelog.py:307] 2455.12M processor_test_nagrawal_queue: Total latency ms: 2582, Event latency ms: 1271, Num events: 37, Mem used: 4 MB, (Event, count, latency ms): [['ai_interview_feedback_email_send_operation', {'num': 1, 'total_ms': 2550}], ['prod_db_read', {'num': 19, 'total_ms': 832}], ['prod_db_read_user_messages', {'num': 3, 'total_ms': 396}], ['prod_db_read_user_email_templates', {'num': 5, 'total_ms': 164}], ['prod_db_read_user_login', {'num': 2, 'total_ms': 149}], ['redis.get', {'num': 79, 'total_ms': 110}], ['upload_to_s3', {'num': 2, 'total_ms': 92}], ['prod_db_read_email_delivery_feedback', {'num': 4, 'total_ms': 82}], ['prod_db_write', {'num': 3, 'total_ms': 75}], ['download_from_s3', {'num': 1, 'total_ms': 56}]], Slowest 3 events [{'idx': 30, 'event': 'ai_interview_feedback_email_send_operation', 'latency_ms': 2550.4, 'extra': '{"operations": ["ai_interview_feedback_email_send_operation"], "_traceback": "truncated", "_parent_msg_id": "d05e2e95-4752-463a-b145-ad617aa183fa", "_parent_trace_id": "5579d52321834802b1defcef73fa4a60", "_message_dispatched_ts": 1759866887.2055233, "_dispatch_host": "172.31.27.172", "_queue_name": "ai_interview_op_queue", "_parent_queue_name": "test_nagrawal_queue", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "import@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "rds_id": 77215}', 'is_aggregate_event': True}, {'idx': 12, 'event': 'prod_db_read', 'latency_ms': 298.6, 'extra': '{"query": "SELECT * FROM user_messages WHERE id=%s LIMIT 1 /* dev=nagrawal */", "breakdowns": ["user_messages"], "retries": []}', 'rows_returned': 0}, {'idx': 18, 'event': 'prod_db_read', 'latency_ms': 147.2, 'extra': '{"query": "SELECT * FROM user_login WHERE email=%s AND group_id=%s LIMIT 1 /* dev=nagrawal */", "breakdowns": ["user_login"], "retries": []}', 'rows_returned': 1}] PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:03.102432 78574 worker.py:759] 2455.12M Ending processing of message 3616c56f-fa60-43fc-b1eb-08e6dcbadd00 latency: 2.596147298812866 PMID: 5579d52321834802b1defcef73fa4a60 SMID: 3616c56f-fa60-43fc-b1eb-08e6dcbadd00
I1007 19:55:03.107070 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:55:03.112743 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:55:15.122139 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:55:15.126171 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:55:27.135260 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:55:27.141411 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:55:39.156542 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:55:39.164095 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:55:49.173389 78574 firehose_utils.py:98] 2455.12M Publishing search_query_log to firehose with 10 entries
I1007 19:55:49.262711 78574 firehose_utils.py:98] 2455.12M Publishing ai_interview_eval_log to firehose with 1 entries
I1007 19:55:49.283630 78574 firehose_utils.py:98] 2455.12M Publishing processor_event_log to firehose with 13 entries
E1007 19:55:49.299283 78574 counters.py:319] 2455.12M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:55:51.304660 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:55:51.308973 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:56:01.316621 78574 firehose_utils.py:98] 2455.12M Publishing db_query_log to firehose with 4 entries
I1007 19:56:03.431362 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:56:03.439393 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:56:13.448685 78574 firehose_utils.py:98] 2455.12M Publishing etl_entity_log to firehose with 3 entries
I1007 19:56:15.560460 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:56:15.566104 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:56:27.575561 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:56:27.579286 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:56:39.634473 78574 worker.py:183] 2455.12M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:56:39.642414 78574 worker.py:275] 2455.12M Fetching messages from queue test_nagrawal_queue...
I1007 19:56:57.730538 78574 worker.py:297] 2455.12M Received 1 messages from queue test_nagrawal_queue with IDs: ['e589d1e5-cac5-4f8e-b944-4670ab898aa6']
I1007 19:56:57.731025 78574 worker.py:477] 2455.12M Starting processing of message e589d1e5-cac5-4f8e-b944-4670ab898aa6 received at 2025-10-07 19:56:47.000000 with timeout at 2025-10-07 20:26:47.000000
I1007 19:56:57.746378 78574 request_tracelog.py:76] 2455.12M [RequestProfilingInfo] Request with ns: processor and name: processor_test_nagrawal_queue has gevent_profile: False and mem_profile: True
I1007 19:56:57.760777 78574 worker.py:579] 2455.12M TimeToStart for first op index is: 10. Queue: <AWSQueueAdapter name=test_nagrawal_queue>. TopIOIncurred: [['redis.get', {'num': 4, 'total_ms': 4}], ['redis.set', {'num': 1, 'total_ms': 2}]]. PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.761374 78574 worker.py:598] 2455.12M Invoking preprocess for index op PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.761779 78574 worker.py:603] 2455.12M Invoking handle for index op PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.766523 78574 index_operation.py:619] 2455.12M start processing 1 profiles including 0 dupes PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.784063 78574 index_operation.py:273] 2455.12M batch_num 1 profiles_loaded: 1 PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.843853 78574 index_operation.py:300] 2455.12M loaded entities for 1 profiles, {'profile_notes': 0, 'profile_tags': 2, 'event_candidate_activity': 0, 'profile_feedback': 1, 'profile_data': 2, 'scheduled_operation': 1, 'index_op_cached_data': 1} PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.859283 78574 indexed_profile.py:142] 2455.12M index_update_time for 473031799: 1759867018 PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
W1007 19:56:57.903512 78574 phone_utils.py:67] 2455.12M Could not extract phone number without country code from  as (1) The string supplied did not seem to be a phone number. PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
W1007 19:56:57.969007 78574 time_utils.py:251] 2455.24M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
W1007 19:56:57.973528 78574 time_utils.py:251] 2455.24M Failed to parse 2021-08 in ('%Y-%m-%d', '%m/%d/%Y', '%d %b %Y') format PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.983983 78574 entity_objects.py:377] 2455.24M Fetched entities={'acme_markets': <EntityObjects: 'acmemarkets.com' 'Acme Markets'>} from cache for name(s)=Acme PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:57.984621 78574 entity_objects.py:377] 2455.24M Fetched entities={'microsoft': <EntityObjects: 'microsoft.com' 'Microsoft'>, 'google': <EntityObjects: 'google.com' 'Google'>} from cache for name(s)=['Microsoft', 'Google'] PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
W1007 19:56:58.407590 78574 profile_data.py:318] 2457.24M Trying to load data for a namespace 'integrations_assessment' that this group_id 'eightfolddemo-voice-screening.com' doesn't have access to PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
W1007 19:56:58.408073 78574 profile_data.py:318] 2457.24M Trying to load data for a namespace 'integrations_interview' that this group_id 'eightfolddemo-voice-screening.com' doesn't have access to PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:58.522337 78574 profile_index_service.py:55] 2457.24M No employee email found for profile 473031799 PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:58.633193 78574 profile.py:1465] 2459.87M Profile id is not valid: None PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:58.859540 78574 index_operation.py:504] 2459.87M Time taken to index 1 profiles: 1093.2073593139648 ms PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:58.860351 78574 queue_utils.py:212] 2459.87M Deleting message e589d1e5-cac5-4f8e-b944-4670ab898aa6 PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:58.871370 78574 request_tracelog.py:307] 2459.87M processor_test_nagrawal_queue: Total latency ms: 1126, Event latency ms: 390, Num events: 101, Mem used: 4 MB, (Event, count, latency ms): [['index', {'num': 1, 'total_ms': 1098}], ['prod_db_read', {'num': 74, 'total_ms': 153}], ['redis.get', {'num': 90, 'total_ms': 106}], ['log_db_read', {'num': 12, 'total_ms': 34}], ['prod_db_read_profile_data', {'num': 12, 'total_ms': 25}], ['prod_db_read_profile_tags', {'num': 11, 'total_ms': 21}], ['prod_db_read_user_login', {'num': 7, 'total_ms': 19}], ['prod_db_read_event_candidate_activity', {'num': 10, 'total_ms': 18}], ['log_db_read_scheduled_operation', {'num': 6, 'total_ms': 18}], ['prod0_db_read', {'num': 6, 'total_ms': 16}]], Slowest 3 events [{'idx': 96, 'event': 'index', 'latency_ms': 1098.9, 'extra': '{"operations": ["index"], "_traceback": "truncated", "_parent_msg_id": "eightfolddemo-voice-screening.com-37c33bc985844df69ecde3d0fa68de35", "_parent_trace_id": "37c33bc985844df69ecde3d0fa68de35", "_message_dispatched_ts": 1759867007.6744175, "_dispatch_host": "172.31.27.172", "_queue_name": "batch_requests", "_interceptor_stack": [], "_workflow_recipe_ids": [], "_db_access_override_group_id": null, "current_user": "demo@eightfolddemo-voice-screening.com", "group_id": "eightfolddemo-voice-screening.com", "workflow_recipe_id": null, "admin_email": null, "profile_id": 473031799, "num_profiles": 1}', 'is_aggregate_event': True}, {'idx': -1, 'event': 'redis.get', 'latency_ms': 106, 'extra': {'num': 90, 'config': 83, 'solr_indexing_pause': 2, 'profile_utils': 1, 'work_title_tenure_data': 1, 'title_tenure_data': 1, 'log': 1, 'custom_field_registry_group_id': 1}}, {'idx': 94, 'event': 'request.ec2-54-188-57-60.us-west-2.compute.amazonaws.com:8000.post', 'latency_ms': 11.8, 'extra': '{"endpoint": "docs?overwrite=true&commitWithin=60000", "status": 200, "url": "http://ec2-54-188-57-60.us-west-2.compute.amazonaws.com:8000/solr/profiles/update/json/docs?overwrit (+25 chars)"}'}] PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
I1007 19:56:58.872201 78574 worker.py:759] 2459.87M Ending processing of message e589d1e5-cac5-4f8e-b944-4670ab898aa6 latency: 1.135213851928711 PMID: 37c33bc985844df69ecde3d0fa68de35 SMID: e589d1e5-cac5-4f8e-b944-4670ab898aa6
E1007 19:56:58.873424 78574 counters.py:319] 2459.87M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:56:58.878123 78574 worker.py:183] 2459.87M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:56:58.883263 78574 worker.py:275] 2459.87M Fetching messages from queue test_nagrawal_queue...
I1007 19:57:10.893722 78574 worker.py:183] 2459.87M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:57:10.897224 78574 worker.py:275] 2459.87M Fetching messages from queue test_nagrawal_queue...
I1007 19:57:22.905162 78574 worker.py:183] 2459.87M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:57:22.909177 78574 worker.py:275] 2459.87M Fetching messages from queue test_nagrawal_queue...
I1007 19:57:34.920937 78574 worker.py:183] 2459.87M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:57:34.924816 78574 worker.py:275] 2459.87M Fetching messages from queue test_nagrawal_queue...
I1007 19:57:46.934592 78574 worker.py:183] 2459.87M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:57:46.944813 78574 worker.py:275] 2459.87M Fetching messages from queue test_nagrawal_queue...
I1007 19:57:59.038014 78574 worker.py:183] 2459.87M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:57:59.042130 78574 worker.py:275] 2459.87M Fetching messages from queue test_nagrawal_queue...
I1007 19:58:09.049587 78574 firehose_utils.py:98] 2459.87M Publishing processor_event_log to firehose with 2 entries
I1007 19:58:09.129741 78574 firehose_utils.py:98] 2459.99M Publishing search_query_log to firehose with 2 entries
E1007 19:58:09.147359 78574 counters.py:319] 2459.99M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:58:11.151432 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:58:11.155424 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:58:23.163632 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:58:23.167841 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:58:35.176947 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:58:35.181466 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:58:47.190021 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:58:47.195960 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:58:59.205342 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:58:59.210498 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
E1007 19:59:09.216260 78574 counters.py:319] 2459.99M NOT PUBLISHING COUNTERS AS CLOUDWATCH IS DISABLED
I1007 19:59:11.219685 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:59:11.223610 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:59:23.232613 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:59:23.236612 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...
I1007 19:59:35.249751 78574 worker.py:183] 2459.99M Not computing allocation since queues was passed [<AWSQueueAdapter name=test_nagrawal_queue>]
I1007 19:59:35.253623 78574 worker.py:275] 2459.99M Fetching messages from queue test_nagrawal_queue...