The present invention discloses a system and for sentence completion in an edge device. The method comprises receiving input from a user through a user interface (202); scrutinizing a length of the received input by a smart sentence composer; sanitizing the received input text and restricting the length of the input text to be within a preset threshold number; splitting the received input text from into letters/words (208); predicting several words and a cluster of most probable word's indices by the smart sentence composer (210), and wherein the word's indices have a similarity above the preset threshold number; converting the word's indices to words using index to word mapping (212); choosing the word/words in the cluster having highest score for prediction (214); and the words are continuously predicted until the end of token of word index (216), is determined for completing the sentence prediction.