arxiv:2510.03528
Ahmed Alajrami
aajrami
·
AI & ML interests
Language Modelling, Interpretability, ML, etc.
Recent Activity
upvoted
a
paper
3 months ago
Deconstructing Attention: Investigating Design Principles for Effective
Language Modeling
authored
a paper
3 months ago
How does the pre-training objective affect what large language models
learn about linguistic properties?
Organizations
models
15
aajrami/bert-sr-base
Feature Extraction
•
0.1B
•
Updated
•
6
aajrami/bert-rand-base
Feature Extraction
•
0.1B
•
Updated
•
12
aajrami/bert-fc-base
Feature Extraction
•
0.1B
•
Updated
•
8
aajrami/bert-sr-medium
Feature Extraction
•
51.5M
•
Updated
•
13
aajrami/bert-rand-medium
Feature Extraction
•
51.5M
•
Updated
•
17
aajrami/bert-fc-medium
Feature Extraction
•
51.5M
•
Updated
•
9
aajrami/bert-sr-small
Feature Extraction
•
38.9M
•
Updated
•
7
aajrami/bert-mlm-medium
Feature Extraction
•
51.5M
•
Updated
•
17
aajrami/bert-fc-small
Feature Extraction
•
38.9M
•
Updated
•
8
aajrami/bert-rand-small
Feature Extraction
•
38.9M
•
Updated
•
12
datasets
0
None public yet