Capability | Azure Data Lake Store | Azure Blob Storage containers |
---|---|---|
Purpose | Optimized storage for big data analytics workloads | General purpose object store for a wide variety of storage scenarios |
Use cases | Batch, streaming analytics, and machine learning data such as log files, IoT data, click streams, large datasets | Any type of text or binary data, such as application back end, backup data, media storage for streaming, and general purpose data |
Structure | Hierarchical file system | Object store with flat namespace |
Authentication | Based on Azure Active Directory Identities | Based on shared secrets Account Access Keys and Shared Access Signature Keys, and Azure role-based access control (Azure RBAC) |
Authentication protocol | OAuth 2.0. Calls must contain a valid JWT (JSON web token) issued by Azure Active Directory | Hash-based message authentication code (HMAC). Calls must contain a Base64-encoded SHA-256 hash over a part of the HTTP request. |
Authorization | POSIX access control lists (ACLs). ACLs based on Azure Active Directory identities can be set file and folder level. | For account-level authorization use Account Access Keys. For account, container, or blob authorization use Shared Access Signature Keys. |
Auditing | Available. | Available |
Encryption at rest | Transparent, server side | Transparent, server side; Client-side encryption |
Developer SDKs | .NET, Java, Python, Node.js | .NET, Java, Python, Node.js, C++, Ruby |
Analytics workload performance | Optimized performance for parallel analytics workloads, High Throughput and IOPS | Not optimized for analytics workloads |
Size limits | No limits on account sizes, file sizes or number of files | Specific limits documented here |
Geo-redundancy | Locally-redundant (LRS), globally redundant (GRS), read-access globally redundant (RA-GRS), zone-redundant (ZRS). | Locally redundant (LRS), globally redundant (GRS), read-access globally redundant (RA-GRS), zone-redundant (ZRS). See here for more information |
No comments:
Post a Comment