You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We introduce a general user model (GUM) that helps computers better understand your actions, needs, and preferences by observing any interaction you have with your computer (with a vision-language model). By using GUMs, apps and assistants can proactively suggest and execute helpful actions without needing to explicitly ask.
170
+
We introduce a general user model (GUM) that helps computers better understand your actions, needs, and preferences by observing any interaction you have with your computer (with a vision-language model). Through observation alone, GUMs construct confidence-weighted natural language propositions. These propositions are iteratively revised based on continued interaction <em>of any kind</em>.
171
171
</p>
172
172
173
+
{/* Example GUM Card */}
174
+
<divstyle={{
175
+
marginTop: '10px',
176
+
marginLeft: 'auto',
177
+
marginRight: 'auto',
178
+
width: '250px'
179
+
}}>
180
+
<divstyle={{
181
+
display: 'flex',
182
+
justifyContent: 'space-between',
183
+
marginBottom: '4px',
184
+
paddingLeft: '1px',
185
+
paddingRight: '1px'
186
+
}}>
187
+
<divstyle={{
188
+
color: 'var(--color-main-text)',
189
+
fontSize: '15px'
190
+
}}>
191
+
proposition
192
+
</div>
193
+
<divstyle={{
194
+
color: 'var(--color-main-text)',
195
+
fontSize: '15px'
196
+
}}>
197
+
confidence
198
+
</div>
199
+
</div>
200
+
<divstyle={{
201
+
display: 'flex',
202
+
alignItems: 'center',
203
+
backgroundColor: 'var(--color-main-text)',
204
+
borderRadius: '8px',
205
+
padding: '16px',
206
+
paddingTop: '12px',
207
+
paddingBottom: '12px'
208
+
}}>
209
+
<divstyle={{
210
+
width: '340px',
211
+
color: '#333',
212
+
fontFamily: 'sans-serif',
213
+
fontSize: '16px',
214
+
lineHeight: '1.2'
215
+
}}>
216
+
User is interested in General User Models
217
+
</div>
218
+
<divstyle={{
219
+
width: '1px',
220
+
backgroundColor: '#888888',
221
+
height: '40px',
222
+
margin: '0 8px'
223
+
}}></div>
224
+
<divstyle={{
225
+
flex: 1,
226
+
fontWeight: 'bold',
227
+
fontSize: '17px',
228
+
color: '#333',
229
+
textAlign: 'center'
230
+
}}>
231
+
0.9
232
+
</div>
233
+
</div>
234
+
</div>
235
+
173
236
</div>
174
237
175
238
@@ -212,7 +275,7 @@ if __name__ == "__main__":
212
275
margin: '0',
213
276
fontSize: '15px'
214
277
}}>
215
-
placeholder placeholder placeholder...
278
+
Apps and assistants can use GUMs to enable a breadth of applications, like proactively suggest and execute helpful actions without needing to explicitly ask.
216
279
</p>
217
280
</div>
218
281
@@ -282,10 +345,53 @@ if __name__ == "__main__":
282
345
</SyntaxHighlighter>
283
346
</div>
284
347
285
-
<divstyle={{marginTop: '20px'}}>
348
+
<pstyle={{
349
+
lineHeight: '1.6',
350
+
// margin: '0',
351
+
fontSize: '15px'
352
+
}}>
353
+
We also have an <ahref="https://github.com/omarshaikh/gum-api"target="_blank"rel="noopener noreferrer"style={{color: '#ff9d9d'}}>example in the repository</a> that connects GUMs to a Model Context Protocol, so you can easily plug a GUM into any chat-based assistant.
354
+
</p>
355
+
286
356
<h3style={{
287
357
color: 'var(--color-main-text)',
288
-
margin: '0 0 15px 0',
358
+
margin: '20px 0 15px 0',
359
+
fontSize: '20px',
360
+
fontWeight: '600',
361
+
display: 'flex',
362
+
alignItems: 'center'
363
+
}}>
364
+
How it works
365
+
</h3>
366
+
<pstyle={{
367
+
lineHeight: '1.6',
368
+
margin: '0',
369
+
fontSize: '15px'
370
+
}}>
371
+
placeholder placeholder placeholder...
372
+
</p>
373
+
374
+
<h3style={{
375
+
color: 'var(--color-main-text)',
376
+
margin: '20px 0 15px 0',
377
+
fontSize: '20px',
378
+
fontWeight: '600',
379
+
display: 'flex',
380
+
alignItems: 'center'
381
+
}}>
382
+
Results
383
+
</h3>
384
+
<pstyle={{
385
+
lineHeight: '1.6',
386
+
margin: '0',
387
+
fontSize: '15px'
388
+
}}>
389
+
placeholder placeholder placeholder...
390
+
</p>
391
+
392
+
<h3style={{
393
+
color: 'var(--color-main-text)',
394
+
margin: '20px 0 15px 0',
289
395
fontSize: '20px',
290
396
fontWeight: '600',
291
397
display: 'flex',
@@ -305,7 +411,7 @@ if __name__ == "__main__":
305
411
}}>
306
412
<preid="bibtex-content"style={{margin: '0'}}>
307
413
{`@article{shaikh2025gums,
308
-
title={Learning General User Models from Computer Use},
414
+
title={Creating General User Models from Computer Use},
309
415
author={Shaikh, Omar and Sapkota, Shardul and Rizvi, Shan and Horvitz, Eric and Park, Joon Sung and Yang, Diyi and Bernstein, Michael S.},
0 commit comments