A Continued Look at AWS Cost Explorer: Part 2 of 2

Frequently Asked Questions

Features & Capabilities

How does N2WS help track and manage AWS EBS snapshot costs?

N2WS automates the backup and recovery of AWS resources using EBS snapshots. By leveraging AWS Cost Explorer's cost allocation tags, N2WS enables you to tag snapshots by project, team, or department. These tags are then visible in Cost Explorer, allowing you to monitor and predict backup costs at a granular level. For example, you can track costs by department or backup type (hourly, daily, weekly) using tags like 'Hourly_Accounting' or 'Weekly_Financing'. Note: You must activate user-defined tags in AWS Billing and Management before they appear in Cost Explorer. Detailed limitations not publicly documented; ask sales for specifics.

What steps are required to view N2WS-created snapshot costs in AWS Cost Explorer?

To view N2WS-created snapshot costs in AWS Cost Explorer, follow these steps: 1) Tag your EBS snapshots using a consistent tagging policy (e.g., by project or department). 2) Activate these tags in the AWS Billing and Management console under 'Cost Allocation Tags'. 3) In Cost Explorer, filter by 'Usage Type Group' (select 'EC2: EBS – Snapshots') and group by your activated tag. This process provides detailed visibility into backup costs by business unit or backup type. Note: Tags must be activated before they appear in Cost Explorer. Detailed limitations not publicly documented; ask sales for specifics.

Can N2WS automate backup scheduling and tagging for cost allocation?

Yes, N2WS can automate backup scheduling using AWS tags. N2WS scans your AWS resources and schedules them for backup based on tag policies. It can also copy tags from original volumes to snapshots, enabling you to use AWS Cost Explorer's cost allocation tags for granular cost tracking. This helps you monitor backup costs by department, project, or backup type. Note: Tagging must be properly configured and tags activated in AWS for this to work. Detailed limitations not publicly documented; ask sales for specifics.

What is the Interactive AWS Cost Explorer API and how does it relate to N2WS users?

The Interactive AWS Cost Explorer API allows users to programmatically retrieve cost and usage data, summarize it by dimensions such as service, account, or tag, and aggregate it over specific time periods. For N2WS users, this means you can automate cost analysis for N2WS-created snapshots and other resources. Note: Each API call costs .01, and the API supports two levels of grouping, while the web interface supports one. Best fit for users needing programmatic access; those who only need basic reporting may prefer the web interface.

How does N2WS integrate with AWS tagging and cost allocation features?

N2WS supports tagging of AWS resources and snapshots, which can be used for cost allocation in AWS Cost Explorer. By tagging resources with keys like 'cpm backup' and values matching backup policy names, N2WS ensures that backup costs can be tracked by business unit or backup type. These tags are copied to snapshots and, once activated in AWS, appear in Cost Explorer for detailed cost analysis. Note: Tagging policies must be consistently applied and tags activated in AWS. Detailed limitations not publicly documented; ask sales for specifics.

Use Cases & Benefits

Who benefits from using N2WS with AWS Cost Explorer?

Organizations using AWS for backup and disaster recovery benefit from N2WS's integration with AWS Cost Explorer. This includes IT managers, cloud directors, and finance teams who need to track, allocate, and optimize backup costs across departments or projects. N2WS's tagging and automation features make it easier to monitor spending and adjust backup strategies for cost efficiency. Note: Best fit for organizations with complex AWS environments; smaller teams with simple backup needs may not require this level of granularity.

What are the main pain points N2WS addresses for AWS backup cost management?

N2WS addresses several pain points in AWS backup cost management: 1) Difficulty in tracking and allocating EBS snapshot costs, 2) Manual and error-prone backup scheduling, 3) Lack of visibility into backup spending by department or project, and 4) Complexity in managing backup policies at scale. By automating tagging and integrating with AWS Cost Explorer, N2WS provides granular cost visibility and control. Note: Some manual setup is required for tagging and activation. Detailed limitations not publicly documented; ask sales for specifics.

Technical Requirements & Documentation

Where can I find technical documentation for N2WS and AWS Cost Explorer integration?

Technical documentation for N2WS, including user guides and best practices for backup, tagging, and integration with AWS features, is available at docs.n2ws.com/user-guide. For AWS Cost Explorer and tagging, refer to AWS's official documentation and the N2WS blog series on cost management. Note: For advanced integration or automation, consult the N2WS RESTful API documentation. Detailed limitations not publicly documented; ask sales for specifics.

Competition & Comparison

How does N2WS compare to AWS Backup for cost tracking and automation?

N2WS offers several advantages over AWS Backup for cost tracking and automation: 1) N2WS provides automated tagging and integration with AWS Cost Explorer for granular cost allocation, while AWS Backup requires more manual setup. 2) N2WS supports immutable backups, cross-cloud recovery (AWS and Azure), and granular restore, which AWS Backup does not. 3) N2WS offers a RESTful API for automation, whereas AWS Backup relies on Lambda scripting. Note: AWS Backup may be preferable for users with simple AWS-only environments and basic backup needs. N2WS is best fit for organizations needing advanced features and multi-cloud support. Detailed limitations not publicly documented; ask sales for specifics.

A Continued Look at AWS Cost Explorer:

EBS Snapshots, Tagging, API and Reserved Instance Purchase Recommendations

In part one of this series, we looked at the benefits of using AWS Cost Explorer to gain greater insight into your AWS costs. We discussed how you can observe your costs over time and how to use the forecasting capabilities to predict future spending with confidence. In this final part of the series, we will continue with our overview and we will also focus on some of the recent updates that were introduced, such as the redesigned interface for easier use, cost allocation for EBS snapshots which greatly improves cost management capabilities with AWS, the new Interactive Cost Explorer API which allows you to programmatically retrieve cost and usage data and finally, the new Reserved Instance purchase recommendations which help further identify opportunities for cost savings.

Overview of Cost Explorer Features Continued

The latest update to Cost Explorer brought the redesigned user interface that improves many common workflows, such as filtering and the grouping of data. Filtering is a major feature of Cost Explorer, as it lets you isolate the exact data you want by parsing just what you need from the vast amount of information presented. You can narrow down your choice and filter by service (focusing only on EC2 instances or S3, for example), instance type (looking only at t2.micro or m4.xlarge), or even API operation (looking only at CreateSnapshot of GetObject API calls). For an even more fine-grained view, you can apply multiple filters, and only the intersecting data will be shown.

Another feature of Cost Explorer is the “Group By” option, which lets you display data grouped by the same previously mentioned filters. If you are filtering data by EC2 instance, you can, for example, use this option to group by region. The result will be a chart that shows separate EC2 data for each region being used. On the other hand, if you choose to group by usage type, you can expect to see all EC2 instance types that you used during the selected time period, along with the costs they produced.

Cost Allocation for EBS Snapshots

Calculating the cost of your EBS snapshots used to be little more than a rough estimation, while methods that were slightly more accurate required tool installation (such as Performance Monitor for Windows or an open source tool iotop for Linux) and looking at patterns over time. This process was complex, but necessary, as EBS snapshots are a crucial part of any Disaster Recovery strategy and their cost must be taken into consideration. In May of this year, AWS announced that they would be updating their EBS service to support cost allocation tags for EBS snapshots.

This new feature allows you to expose your EBS snapshots using tags and then view the data using the Cost Explorer or Reports. Snapshot forecasting is a major update that makes it easier than ever to understand and manage your spending with AWS. This is especially useful for N2WS Backup & Recovery customers, because N2WS automates backup and recovery in AWS using snapshots. You now have a clear view into the cost of N2WS-created snapshots, which lets you adjust your backup and DR strategies accordingly. In order to fully utilize this new feature, there are a few steps you need to take first:

Step 1 – Tagging Snapshots

Before you can see your exposed snapshots, you have to tag them first. You can create tags per project, team, client or anything else. Make sure you have a tagging policy and that each snapshot is tagged properly so that it can be shown in Cost Explorer. Using Tag Editor, find and tag the desired snapshots, or alternatively, you can use AWS CLI or AWS API to add or overwrite tags for specified snapshots.

Using Cost Allocation Tags with N2WS Backup & Recovery

N2WS is an enterprise backup, recovery and disaster recovery solution for Amazon EC2. The solution allows you to automate backups, maintain and recover your entire EC2 (as well as RDS, Amazon Redshift, Amazon DynamoDB & Amazon Aurora) environment as well as achieve application-consistent backups. In addition to the many features N2WS has, it also offers automated backup scheduling using AWS tags. N2WS can scan your AWS resources automatically and schedule them for backup. You can also using N2WS’s tagging feature to identify snapshots that you would like to keep track of in Cost Explorer. This makes it extremely easy to monitor and predict costs for specific departments, for example.

To enable tagging, you must have added tag with key as “cpm backup” and value as your cpm backup policy name. If a policy with the defined name does not exist, N2WS will create the policy. By using N2WS to tag your original volumes, these tags can be copied to the snapshots – allowing you to use the Cost Allocation Tags feature. Alternatively, you can use the”cpm_policy_name” tag that N2WS creates for every snapshot. This will also allow you to see the cost not just by business unit, but by backup type. For example, following these tagging identifiers, you will be able to see backup costs per department, as well as granular visibility including hourly, daily and weekly backups: Tagging Identifiers Using N2WS Backup & Recovery Hourly_Accounting Daily_Accounting Weekly_Accounting Hourly_Financing Daily_Financing Weekly_Financing, etc…

Step 2 – Activating New Tags

All user-defined tags have to be activated before they can appear in Cost Explorer or in the Reports. Under the Billing and Management page, open “Cost Allocation Tags”. Locate your newly created tags on the list and activate them.

AWS Cost Explorer - Cost Allocation Tags

Step 3 – Viewing Snapshot Data in Cost Explorer

Open up Cost Explorer and filter your data using “Usage Type Group” and then select “EC2: EBS – Snapshots”. Then set the “Group By” option to tag and select the tag that you have previously created and activated. You now have a very detailed overview of your EBS snapshot costs.

Interactive Cost Explorer API

Since there are many companies that are moving large amounts of raw data into the AWS Cloud, there had been a gap that needed to be filled because customers were still extracting data because they could not programmatically explore their costs and usage within Cost Explorer. In November 2017, Amazon introduced Interactive Cost Explorer API. Now a user can retrieve cost and usage metrics and summarize this data by various dimensions (Service, Availability Zone, Account, etc.), and on top of that aggregate the data for a specific time period.

Access to Interactive Cost Explorer gives the user much more control over how they can drill down their data. By having this kind of transparency, you will be able to see your infrastructure expenses for specific tagged events or marketing campaigns, for usage of a DynamoDB database table in your production environment, for example, or drill down to see overall monthly costs and even daily usage. There are a few things to keep in mind when using Interactive Cost Explorer API. API’s give you two levels of grouping while the Cost Explorer web application provides one level. This will give you the ability to group costs, for example, by an Availability Zone and then by Service. Also, each API call costs $0.01 which is still far less expensive than extracting and grouping the data within your own system.

Reserved Instance Purchase Recommendations

Back in December of 2016, Amazon announced that Reserved Instance (RI) Utilization Reports will be added to Cost Explorer in order to help the user better understand their costs and usage. Through these reports, the user will now better understand their utilization, instance type, purchasing account and other reserve-related information within a specified time period. In addition, the user can define a threshold and identify specific reserve instances that have maxed out those limits.

Amazon made another announcement in November 2017 detailing another means to help you understand and optimize your usage of EC2. By retrieving information from Cost Explorer, Reserved instance purchase recommendations can now be accessed. Cost Explorer can even identify instance family usage that can be optimized with your reserve instances. The parameters can be managed and revised according to an organization’s needs (for specific time periods for example). Once a user understands how to properly optimize their Amazon EC2 RI’s, they can purchase them directly through the link in Cost Explorer.

Summary

AWS Cost Explorer allows for a precise view of your spending, using filters and charts to parse and present data. It’s cost prediction capabilities using forecasting and confidence give you a reliable method of determining your potential spending in the near future. Thanks to the powerful new option to track EBS snapshots using tags, if you use N2WS, you can get a more comprehensive view of your snapshot costs, while keeping your data safe. And with improvements to the interface, as well as all the new features that are continually being pushed out in order to help organizations optimize their usage and spending, this free tool is essential for anyone using AWS. Catch up on Part I of our AWS Cost Explorer analysis here.