Sawdust near a window frame — is this carpenter ants?

Noticed fine sawdust (frass?) on the window sill this morning. Small pile, maybe a teaspoon. Saw one big black ant yesterday. Starting to worry.