MiSSKrSSKrSSKJr SSKJr SSKJr SSKJ r J r SSK J r J r "SS\R5r"S S \5r"S S 5rg) N)Optional) BaseModel) print_verbose) DualCache RedisCache)DEFAULT_IN_MEMORY_TTLDEFAULT_POLLING_INTERVALc\rSrSrSr\rSrg)SchedulerCacheKeys zscheduler:queueN)__name__ __module__ __qualname____firstlineno__queuerdefault_in_memory_ttl__static_attributes__r k/var/www/eduai.edurigo.com/storigo/production/storigo_env/lib/python3.13/site-packages/litellm/scheduler.pyr r s Err c4\rSrSr%\\S'\\S'\\S'Srg)FlowItempriority request_id model_namer N)rrrrint__annotations__strrr rrrrsMOOrrc\rSrSr%\\S'SS\\S\\4Sjjr S\ 4Sjr S \ S \ S \ S \4S jrS \ S \ S \ S \4SjrSrS \ S \ 4SjrS\ S \ S S4SjrSrg) SchedulercacheNpolling_interval redis_cachec/UlSnUb[RRn[ X#S9UlU=(d [ Ulg)zO polling_interval: float or null - frequency of polling queue. Default is 3ms. N)r%r)rr rvaluerr#r r$)selfr$r%rs r__init__Scheduler.__init__sK 15  "$6$L$L$R$R !#    8 8 rrequestc# URURS9IShvN n[R"X!RUR 45 UR X!RS9IShvN gNRN7f)Nr)rr) get_queuerheapqheappushrr save_queue)r(r+rs r add_requestScheduler.add_request0senn0B0BnCC u//1C1CDEooE6H6HoIII D Js"A6A2A A6,A4-A64A6idrhealth_deploymentsreturncR# URUS9IShvN nU(d[SRU55e[S[ U535 [ U5S:XaC[SUSU35 USSU:Xa%[ R "U5 [S U35 g g g N7f) z Return if request can be processed. Returns: - True: * If healthy deployments are available * OR If request at the top of queue - False: * If no healthy deployments available * AND request not at the top of queue r-N-Incorrectly setup. Queue is invalid. Queue={}zlen(health_deployments): rzqueue: z , seeking id=z Popped id: TF)r. Exceptionformatrlenr/heappopr(r4rr5rs rpollScheduler.poll:snn n;;?FFuM  1#6H2I1JKL ! "a ' GE7-t< =Qx{b  e$ B401-s rpeekScheduler.peek^sSnn n;;?FFuM  8A;" r\sB !9My oor