A rumen simulation technique was used to evaluate the effects of the complete substitution of a common concentrate mixture (CON) with a mixture consisting solely of by-products from the food industry (BP) at 2 different forage-to-concentrate ratios on ruminal fermentation profile, nutrient degradation, and abundance of rumen microbiota. The experiment was a 2×2 factorial arrangement with 2 concentrate types (CON and BP) and 2 concentrate levels (25 and 50% of diet dry matter). The experiment consisted of 2 experimental runs with 12 fermentation vessels each (n=6 per treatment). Each run lasted for 10d, with data collection on the last 5d. The BP diets had lower starch, but higher neutral detergent fiber (NDF) and fat contents compared with CON. Degradation of crude protein was decreased, but NDF and nonfiber carbohydrate degradation were higher for the BP diets. At the 50% concentrate level, organic matter degradation tended to be lower for BP and CH4 formation per unit of NDF degraded was also lower for BP. The BP mixture led to a higher concentration of propionate and a lower acetate-to-propionate ratio, whereas concentrations of butyrate and caproate decreased. Concentrate type did not affect microbial community composition, except that the abundance of bacteria of the genus Prevotella was higher for BP. Increasing the concentrate level resulted in higher degradation of organic matter and crude protein. At the higher concentrate level, total short-chain fatty acid formation increased and concentrations of isobutyrate and valerate decreased. In addition, at the 50% concentrate level, numbers of protozoa increased, whereas numbers of methanogens, anaerobic fungi, and fibrolytic bacteria decreased. No interaction was noted between the 2 dietary factors on most variables, except that at the higher concentrate level the effects of BP on CH4 and CO2 formation per unit of NDF degraded, crude protein degradation, and the abundance of Prevotella were more prominent. In conclusion, the results of this study suggest that BP in the diet can adequately substitute CON with regard to ruminal fermentation profile and microbiota, showing even favorable fermentation patterns when fed at 50% inclusion rate.