Yes, a summary report with one sub-summary part is what you need here to get each of the subtotals shown on the green rows. Each white row in your example image would be a separate record and you'd use summary fields to compute totals and sub-totals. The trick is to sort your records by Section and then specify the section field as the "sorted by" field selected in the part setup for your sub-summary part.
You would set this report up in List View.
If you are new to summary report, you might investigate this tutorial on the subject:
Thanks for the reply! I'll take a look at the tutorial and use a sub-summary part as you suggested.