Skip to content

Commit ec7e5a7

Browse files
committed
fix(seo): drop unverified Grok UAs, correct DeepSeekBot and ImagesiftBot tokens
1 parent 2c78835 commit ec7e5a7

1 file changed

Lines changed: 2 additions & 5 deletions

File tree

apps/sim/app/robots.ts

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -84,16 +84,13 @@ const SEARCH_AND_AI_BOTS = [
8484
'CCBot',
8585
'cohere-ai',
8686
'cohere-training-data-crawler',
87-
'GrokBot',
88-
'xAI-Grok',
89-
'Grok-DeepSearch',
9087
'MistralAI-User',
91-
'DeepSeek-AI',
88+
'DeepSeekBot',
9289
'YouBot',
9390
'Diffbot',
9491
'AI2Bot',
9592
'Timpibot',
96-
'ImageSiftBot',
93+
'ImagesiftBot',
9794
]
9895

9996
/**

0 commit comments

Comments
 (0)