github/OpenHands
1
0
Fork 0
mirror of https://github.com/OpenHands/OpenHands.git synced 2026-03-22 13:47:19 +08:00
Code Issues Packages Projects Releases Wiki Activity

Add Anthropic Models to Cache Prompt (#3775)

Browse Source 
* Add Anthropic Models to Cache Prompt

* Update Cache Prompt Active Check for Partial String Matching
This commit is contained in:
Cole Murray
2024-09-08 15:09:14 -07:00
committed by GitHub
parent ab3851593d
commit dadada18ce
1 changed files with 2 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
openhands/llm/llm.py
View File

@@ -478,9 +478,8 @@ class LLM:
Returns:
boolean: True if prompt caching is active for the given model.
"""
return (
self.config.caching_prompt is True
and self.config.model in cache_prompting_supported_models
return self.config.caching_prompt is True and any(
model in self.config.model for model in cache_prompting_supported_models
)
def _post_completion(self, response) -> None: