WinBUGS is described as 'is statistical software for Bayesian analysis using Markov chain Monte Carlo (MCMC) methods. It is based on the BUGS (Bayesian inference Using Gibbs Sampling). It runs under Microsoft Windows, though it can also be run on Linux using Wine' and is a Statistical Analyzer in the category. There are more than 10 alternatives to WinBUGS for Windows, Linux, Mac, Xfce and BSD. The best alternative is R (programming language), which is both free and Open Source. Other great apps like WinBUGS are RStudio (Free, Open Source), PSPP (Free, Open Source), RKWard (Free, Open Source) and STATISTICA (Paid).
PSPP is a free software application for analysis of sampled data. It has a graphical user interface and conventional command line interface. It is written in C, uses GNU Scientific Library for its mathematical routines, and plotutils for generating graphs.
Deducer is designed to be a free easy to use alternative to proprietary data analysis software such as SPSS, JMP, and Minitab. It has a menu system to do common data manipulation and analysis tasks, and an excel-like spreadsheet in which to view and edit data frames.
SOFA Statistics is an open-source statistical package, with an emphasis on ease of use, learn as you go, and beautiful output. The name stands for Statistics Open For All. It has a graphical user interface and can connect directly to MySQL, SQLite, MS Access, and MS SQL Server.