Netflix Cloud Security: Detecting Credential Compromise in AWS

Netflix Technology Blog
9 min readbeginner
--
View Original

Overview

The article discusses Netflix's methodology for detecting credential compromise in AWS environments, emphasizing the importance of monitoring temporary security credentials. It outlines a systematic approach to identify unauthorized API calls made with compromised credentials, thereby enhancing cloud security.

What You'll Learn

1

How to detect API calls with AWS EC2 temporary security credentials outside of your environment

2

Why monitoring AWS API calls is crucial for identifying credential compromise

3

When to apply the methodology for analyzing CloudTrail records

Prerequisites & Requirements

  • Familiarity with AWS EC2 and IAM roles
  • Understanding of AWS CloudTrail logs

Key Questions Answered

How can organizations detect compromised AWS instance credentials?
Organizations can detect compromised AWS instance credentials by analyzing CloudTrail logs for API calls made with temporary security credentials. By tracking the source IP addresses of these calls, they can identify if the credentials are being used outside of their AWS environment, indicating potential compromise.
What are the advantages of Netflix's methodology for detecting credential compromise?
The advantages include the ability to detect API calls without prior knowledge of IP allocations, achieving full coverage in six hours or less, and applying the methodology in real-time or on historical CloudTrail data. This enhances the organization's ability to respond to potential security threats effectively.
What edge cases should be considered when detecting credential compromise?
Edge cases include scenarios where AWS makes calls on behalf of the user, the presence of VPC endpoints that show private IP addresses, and changes in network interfaces that may introduce new IPs. These factors can lead to false positives if not accounted for in the detection methodology.

Technologies & Tools

Some links below are affiliate links. We may earn a commission if you make a purchase.

Key Actionable Insights

1
Implement a monitoring system for AWS CloudTrail logs to track API calls made with temporary security credentials.
This proactive measure allows organizations to quickly identify unauthorized access and respond to potential security incidents before they escalate.
2
Regularly update the TTL for assumed role entries in your monitoring table to ensure accurate tracking of active credentials.
Since AWS refreshes credentials every 1-6 hours, maintaining an updated TTL helps prevent false positives and ensures that only valid credentials are monitored.
3
Create a comprehensive list of potential IP addresses associated with your AWS environment to enhance detection capabilities.
While the methodology allows for monitoring without prior knowledge of IPs, having a list can improve the accuracy of identifying compromised credentials and reduce false positives.

Common Pitfalls

1
Failing to account for AWS making calls on behalf of the user can lead to false positives in detecting compromised credentials.
This occurs because legitimate AWS service calls may appear as unauthorized access if not properly monitored, emphasizing the need for a nuanced approach to analyzing API call logs.
2
Not updating the monitoring table for new IP addresses associated with an EC2 instance can result in missed detections.
When new network interfaces are attached or new addresses are associated, failing to update the table can lead to incorrect assumptions about credential usage and potential security breaches.

Related Concepts

AWS IAM Roles And Permissions
AWS Cloudtrail Logging
Security Best Practices In Cloud Environments