The Bible does not give us a definite answer regarding the state of little children who are too young to understand the gospel and trust in Christ as their personal Savior. However, based on certain principles of Scripture, many believe (and I am one of them), that children who are too young to grasp the issues of the gospel, will be in heaven. The reason is simply this: Jesus Christ, God’s Son, died on the cross for the sin of the whole world (1 John 2:2; 1 Tim. 4:2). He and He alone is the Savior of all men and the means of receiving that salvation is by personal faith in Christ. But this can only really apply to those who can believe. Since Christ died for all our sin, the only sin that can keep a person separated from God is the sin of unbelief or rejection of Christ. Listen to the passage below which speaks about the convicting ministry of the Holy Spirit in regard to the person of Christ:
And He, when He comes, will convict the world concerning sin, and righteousness, and judgment; concerning sin, because they do not believe in Me; and concerning righteousness, because I go to the Father, and you no longer behold Me; and concerning judgment, because the ruler of this world has been judged (John 16:8-11).
Notice that Jesus said, “concerning sin, because they do not believe in Me.” All people are sinners and must recognize this, “for all have sinned and come short of the glory of God” (Rom. 3:23), but no one is saved by giving up their sins (Eph. 2:8-9; Tit. 3:5), but rather by faith in Christ’s work who alone could and did pay the penalty for our sin. So, the greatest and basic sin is unbelief. Jesus’ return to the Father vindicates His righteous life and the truthfulness of all He said which includes John 14:6. Further, His statement about the ruler of this world having been judged shows that at the cross Christ triumphed over Satan. This serves notice on all unbelievers (those who refuse to believe in Christ) of their judgment to come. Satan’s judgment proves the judgment of all who do not believe in Christ.
But babies cannot understand that they are sinners, neither can they reject Christ. So, since Christ paid for their sin by His death on the Cross, many believe that little children will be in heaven. Also, remember that when David lost his child, who died before the age of accountability, David stopped his mourning and said, “he can’t come to me, but I will go to him.” While some believe this just means David would be gathered to his son in the grave, this passage may suggest David believed that one day he would see his child in heaven (see 2 Sam. 12:23). While this verse does not prove this concept, it certainly lends support since David seemed to be comforted by this thought.
Let me point out, however, that not all Christians and Bible teachers believe this about children and will simply say that we cannot know the answer to this since the Bible does not give us specific answers. Others would apply this only to the children of believers on the basis of 1 Corinthians 7:14.